Apr 15 13:27:43 devstack cinder-volume[72951]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 13:27:43 devstack cinder-volume[72951]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 13:27:43 devstack cinder-volume[72951]: we strongly recommend against using it for new projects. Apr 15 13:27:43 devstack cinder-volume[72951]: If you are already using Eventlet, we recommend migrating to a different Apr 15 13:27:43 devstack cinder-volume[72951]: framework. For more detail see Apr 15 13:27:43 devstack cinder-volume[72951]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 13:27:43 devstack cinder-volume[72951]: import eventlet # noqa Apr 15 13:27:45 devstack cinder-volume[72951]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72951) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 13:27:45 devstack cinder-volume[72951]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72951) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 13:27:45 devstack cinder-volume[72951]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72951) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 13:27:46 devstack cinder-volume[72951]: INFO dbcounter [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Registered counter for database cinder Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72951) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG dbcounter [-] [72951] Writer thread running {{(pid=72951) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 13:27:46 devstack cinder-volume[72951]: INFO cinder.rpc [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 13:27:46 devstack cinder-volume[72951]: INFO cinder.rpc [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72951) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:27:46 devstack cinder-volume[72951]: INFO cinder.volume.manager [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Determined volume DB was empty at startup. Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG cinder.volume.manager [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72951) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 13:27:46 devstack cinder-volume[72951]: INFO cinder.volume.manager [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 13:27:46 devstack cinder-volume[72951]: WARNING stevedore.named [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 13:27:46 devstack cinder-volume[72951]: WARNING castellan.key_manager [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 13:27:46 devstack cinder-volume[72951]: WARNING cinder.keymgr.conf_key_mgr [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG cinder.volume.drivers.lvm [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72951) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_concurrency.processutils [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_concurrency.processutils [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] CMD "cinder-rtstool verify" returned: 0 in 0.277s {{(pid=72951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72951) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:27:46 devstack cinder-volume[72951]: INFO cinder.rpc [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 15 13:27:46 devstack cinder-volume[72951]: INFO cinder.rpc [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 15 13:27:46 devstack cinder-volume[72951]: WARNING stevedore.named [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 13:27:46 devstack cinder-volume[72951]: WARNING castellan.key_manager [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 13:27:46 devstack cinder-volume[72951]: INFO cinder.volume.manager [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72951) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:27:46 devstack cinder-volume[72951]: INFO oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Starting 1 workers Apr 15 13:27:46 devstack cinder-volume[73068]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Started child 73068 {{(pid=72951) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Full set of CONF: {{(pid=72951) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] ******************************************************************************** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Configuration options gathered from: {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] ================================================================================ {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] allow_availability_zone_fallback = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] allow_compression_on_image_upload = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] allowed_direct_url_schemes = [] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] api_rate_limit = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] auth_strategy = keystone {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] az_cache_duration = 3600 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_availability_zone = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_host = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_name = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_stats_polling_interval = 60 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backup_api_class = cinder.backup.api.API {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backup_name_template = backup-%s {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backup_use_same_host = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backup_use_temp_snapshot = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] chap_password = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] chap_username = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cinder_internal_tenant_project_id = 08022539fc524e069f840e03002cf793 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cinder_internal_tenant_user_id = 2818a8ab4172488c9b51609b0c29ef14 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cloned_volume_same_az = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cluster = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] compression_format = gzip {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] compute_api_class = cinder.compute.nova.API {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] config_dir = [] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] config_source = [] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] control_exchange = openstack {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] debug = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] default_availability_zone = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] default_group_type = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] default_volume_type = lvmdriver-1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] disk_geometry = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] driver_client_cert = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] driver_client_cert_key = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] driver_data_namespace = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] driver_ssl_cert_path = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] driver_ssl_cert_verify = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] driver_use_ssl = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] enable_force_upload = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] enable_new_services = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] enable_unsupported_driver = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] enabled_backends = ['lvmdriver-1'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] enforce_multipath_for_image_xfer = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] filter_function = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance_api_insecure = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance_api_servers = ['http://192.168.122.134/image'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance_api_ssl_compression = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance_ca_certificates_file = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance_catalog_info = image:glance:publicURL {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance_certfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance_keyfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance_num_retries = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance_request_timeout = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] goodness_function = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] graceful_shutdown_timeout = 5 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] group_api_class = cinder.group.api.API {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] host = devstack {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] image_compress_on_upload = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] image_conversion_address_space_limit = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] image_conversion_cpu_limit = 60 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] image_conversion_disable = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] image_upload_use_cinder_backend = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] image_upload_use_internal_tenant = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] image_volume_cache_enabled = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] image_volume_cache_max_count = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] image_volume_cache_max_size_gb = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] init_host_max_objects_retrieval = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] instance_format = [instance: %(uuid)s] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] iscsi_target_flags = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] iscsi_write_cache = on {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] iser_helper = tgtadm {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] iser_ip_address = 192.168.122.134 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] iser_port = 3260 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] log_color = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] log_config_append = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] log_dir = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] log_file = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] log_options = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] log_rotate_interval = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] log_rotate_interval_type = days {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] log_rotation_type = none {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] max_age = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] max_logfile_count = 30 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] max_logfile_size_mb = 200 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] max_over_subscription_ratio = 20.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] message_reap_interval = 86400 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] message_ttl = 2592000 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] migration_create_volume_timeout_secs = 300 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] monkey_patch = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] monkey_patch_modules = [] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[73068]: INFO cinder.volume.manager [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] my_ip = 192.168.122.134 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] no_snapshot_gb_quota = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] num_iser_scan_tries = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] num_shell_tries = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] num_volume_device_scan_tries = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] nvmeof_conn_info_version = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] nvmet_ns_id = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] nvmet_port_id = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:46 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] osapi_max_limit = 1000 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] osapi_volume_ext_list = [] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] osapi_volume_listen = 0.0.0.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] osapi_volume_listen_port = 8776 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] osapi_volume_use_ssl = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] osapi_volume_workers = 2 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] per_volume_size_limit = -1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] periodic_fuzzy_delay = 60 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] periodic_interval = 60 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] project_id_regex = [0-9a-f\-]+ {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] public_endpoint = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] publish_errors = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] quota_backup_gigabytes = 1000 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] quota_backups = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] quota_gigabytes = 1000 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] quota_groups = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] quota_snapshots = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] quota_volumes = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] rate_limit_burst = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] rate_limit_except_level = CRITICAL {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] rate_limit_interval = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] reinit_driver_count = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] replication_device = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] report_discard_supported = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] report_interval = 120 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] reservation_clean_interval = 86400 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] reservation_expire = 86400 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] reserved_image_namespaces = [] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] reserved_percentage = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] rpc_response_timeout = 120 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] run_external_periodic_tasks = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] scst_target_driver = iscsi {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] scst_target_iqn_name = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_down_time = 720 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] shell_completion = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] snapshot_name_template = snapshot-%s {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] snapshot_same_host = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] split_loggers = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] state_path = /opt/stack/data/cinder {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] storage_availability_zone = nova {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] storage_protocol = iSCSI {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] syslog_log_facility = LOG_USER {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] target_helper = lioadm {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] target_ip_address = 192.168.122.134 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] target_port = 3260 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] target_protocol = iscsi {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] target_secondary_ip_addresses = [] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] trace_flags = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] transfer_api_class = cinder.transfer.api.API {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] transport_url = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] until_refresh = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] use_chap_auth = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] use_default_quota_class = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] use_journal = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] use_json = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] use_multipath_for_image_xfer = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] use_stderr = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] use_syslog = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] verify_glance_signatures = enabled {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_api_class = cinder.volume.api.API {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_backend_name = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_clear = zero {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_clear_ionice = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_clear_size = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_copy_bps_limit = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_dd_blocksize = 1M {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_name_template = volume-%s {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_service_inithost_offload = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volume_usage_audit_period = month {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] zoning_mode = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_concurrency.disable_process_locking = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.admin_password = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.admin_token = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.admin_user = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.auth_admin_prefix = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.auth_port = 35357 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.auth_protocol = https {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.auth_section = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.auth_type = password {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.auth_uri = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.auth_version = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.cache = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.certfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.delay_auth_decision = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.http_connect_timeout = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.identity_uri = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.include_service_catalog = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.insecure = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.interface = public {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.keyfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_password = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcache_username = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.region_name = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.service_token_roles_required = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.service_type = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.token_cache_time = 300 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.134/identity {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.backend = dogpile.cache.null {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.backend_argument = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.backend_expiration_time = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.config_prefix = cache.oslo {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.debug_cache_backend = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.enable_retry_client = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.enable_socket_keepalive = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.enabled = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.enforce_fips_mode = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.expiration_time = 600 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.hashclient_retry_attempts = 2 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.memcache_dead_retry = 300 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.memcache_pool_maxsize = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.memcache_sasl_enabled = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.password = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.proxies = [] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.redis_db = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.redis_sentinel_service_name = mymaster {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.redis_server = localhost:6379 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.retry_attempts = 2 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.retry_delay = 0.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.socket_keepalive_count = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.socket_keepalive_idle = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.socket_keepalive_interval = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.socket_timeout = 1.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.tls_allowed_ciphers = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.tls_cafile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:47 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.tls_certfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.tls_enabled = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.tls_keyfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cache.username = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] coordination.backend_url = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.asyncio_connection = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.asyncio_slave_connection = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.backend = sqlalchemy {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.connection = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.connection_debug = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.connection_parameters = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.connection_recycle_time = 3600 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.connection_trace = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.db_inc_retry_interval = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.db_max_retries = 20 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.db_max_retry_interval = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack sudo[73073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 15 13:27:47 devstack sudo[73073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.db_retry_interval = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.max_overflow = 50 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.max_pool_size = 5 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.max_retries = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.mysql_wsrep_sync_wait = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.pool_timeout = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.retry_interval = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.slave_connection = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.sqlite_synchronous = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.synchronous_reader = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] database.use_db_reconnect = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.connection_string = messaging:// {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.enabled = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.es_doc_type = notification {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.es_scroll_size = 10000 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.es_scroll_time = 2m {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.filter_error_trace = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.hmac_keys = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.sentinel_service_name = mymaster {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.socket_timeout = 0.1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.trace_requests = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler.trace_sqlalchemy = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler_jaeger.process_tags = {} {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler_jaeger.service_name_prefix = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] profiler_otlp.service_name_prefix = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.enforce_new_defaults = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: WARNING oslo_config.cfg [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.enforce_scope = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.policy_default_rule = default {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.policy_file = policy.yaml {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_policy.remote_timeout = 60.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] privsep_osbrick.group = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] privsep_osbrick.helper_command = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] privsep_osbrick.user = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cinder_sys_admin.group = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cinder_sys_admin.helper_command = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] cinder_sys_admin.user = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_user.auth_section = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_user.auth_type = password {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_user.cafile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_user.certfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_user.collect_timing = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_user.insecure = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_user.keyfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_user.send_service_user_token = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_user.split_loggers = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] service_user.timeout = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance.auth_section = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance.auth_type = password {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance.certfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance.collect_timing = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance.insecure = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance.keyfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance.region_name = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance.split_loggers = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] glance.timeout = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.backend_availability_zone = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.chap_password = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.chap_username = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.disk_geometry = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.driver_client_cert = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.driver_client_cert_key = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.driver_data_namespace = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.driver_use_ssl = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.enable_unsupported_driver = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.extra_capabilities = {} {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.filter_function = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.goodness_function = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.iscsi_target_flags = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.iscsi_write_cache = on {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.iser_helper = tgtadm {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.iser_ip_address = 192.168.122.134 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.iser_port = 3260 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.lvm_mirrors = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.lvm_share_target = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.lvm_type = auto {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.num_shell_tries = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.nvmet_port_id = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.replication_device = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.report_discard_supported = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.reserved_percentage = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.scst_target_driver = iscsi {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.scst_target_iqn_name = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.storage_protocol = iSCSI {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.target_helper = tgtadm {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.target_ip_address = 192.168.122.134 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.target_port = 3260 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.target_protocol = iscsi {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.trace_flags = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.unique_fqdn_network = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.use_chap_auth = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.volume_backend_name = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.volume_clear = zero {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.volume_clear_ionice = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.volume_clear_size = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.volume_group = cinder-volumes {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_reports.file_event_handler = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_reports.log_dir = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.backend_availability_zone = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.backend_host = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.chap_password = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.chap_username = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.chiscsi_conf = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.disk_geometry = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.driver_client_cert = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.driver_data_namespace = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.driver_use_ssl = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.extra_capabilities = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.filter_function = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.goodness_function = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.iser_helper = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.iser_ip_address = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.iser_port = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.iser_target_prefix = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.lvm_conf_file = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.lvm_mirrors = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.lvm_share_target = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.lvm_type = auto {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.num_shell_tries = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.nvmet_port_id = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.replication_device = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.report_discard_supported = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.reserved_percentage = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.scst_target_driver = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.storage_protocol = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.target_helper = lioadm {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.target_ip_address = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.target_port = 3260 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.target_protocol = iscsi {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.trace_flags = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.use_chap_auth = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.volume_clear = zero {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.volume_clear_size = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] lvmdriver-1.volumes_dir = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.ssl = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.ssl_version = {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_notifications.driver = [] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_notifications.retry = -1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] oslo_messaging_notifications.transport_url = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] key_manager.fixed_key = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.barbican_api_version = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.barbican_endpoint = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.barbican_endpoint_type = public {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.barbican_region_name = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.cafile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.certfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.collect_timing = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.insecure = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.keyfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.number_of_retries = 60 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.retry_delay = 1 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.send_service_user_token = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.split_loggers = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.timeout = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.verify_ssl = True {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican.verify_ssl_path = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican_service_user.auth_section = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican_service_user.auth_type = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican_service_user.cafile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican_service_user.certfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican_service_user.collect_timing = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican_service_user.insecure = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican_service_user.keyfile = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican_service_user.split_loggers = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] barbican_service_user.timeout = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.approle_role_id = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.approle_secret_id = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.kv_mountpoint = secret {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.kv_path = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.kv_version = 2 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.namespace = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.root_token_id = **** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.ssl_ca_crt_file = None {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.timeout = 60.0 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.use_ssl = False {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:27:47 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] ******************************************************************************** {{(pid=72951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 13:27:47 devstack sudo[73073]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:47 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:47 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:47 devstack sudo[73180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:27:47 devstack sudo[73180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:48 devstack sudo[73180]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:48 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.537s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:48 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:27:48 devstack cinder-volume[73068]: INFO cinder.brick.local_dev.lvm [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 15 13:27:48 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:48 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:48 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:48 devstack sudo[73380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 13:27:48 devstack sudo[73380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:48 devstack sudo[73380]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:48 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:48 devstack cinder-volume[73068]: DEBUG cinder.brick.local_dev.lvm [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73068) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 15 13:27:48 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:48 devstack sudo[73594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:27:48 devstack sudo[73594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:49 devstack sudo[73594]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:49 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.779s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:49 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:49 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:49 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:49 devstack sudo[73743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:27:49 devstack sudo[73743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:50 devstack sudo[73743]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:50 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:50 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:50 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:50 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:50 devstack sudo[73759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 15 13:27:50 devstack sudo[73759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:50 devstack sudo[73759]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:50 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.458s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:50 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:50 devstack sudo[73762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 13:27:50 devstack sudo[73762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:50 devstack sudo[73762]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:50 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:50 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:50 devstack sudo[73770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 13:27:50 devstack sudo[73770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:51 devstack sudo[73770]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:51 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:51 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:51 devstack sudo[73773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:27:51 devstack sudo[73773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:51 devstack sudo[73773]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:51 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:51 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:51 devstack sudo[73778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:27:51 devstack sudo[73778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:52 devstack sudo[73778]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:52 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.469s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:52 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:52 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:52 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:52 devstack sudo[73782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:27:52 devstack sudo[73782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:52 devstack sudo[73782]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:52 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:52 devstack cinder-volume[73068]: INFO cinder.volume.drivers.lvm [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 15 13:27:52 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:52 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:52 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:52 devstack sudo[73792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:27:52 devstack sudo[73792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:53 devstack sudo[73792]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:53 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:53 devstack cinder-volume[73068]: DEBUG cinder.volume.drivers.lvm [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Updating volume stats {{(pid=73068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 13:27:53 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:53 devstack sudo[73906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 13:27:53 devstack sudo[73906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:53 devstack sudo[73906]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:53 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:53 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:53 devstack sudo[73912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:27:53 devstack sudo[73912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:54 devstack sudo[73912]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:54 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:54 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:54 devstack sudo[74050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:27:54 devstack sudo[74050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:54 devstack sudo[74050]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:54 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:54 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:54 devstack sudo[74056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:27:54 devstack sudo[74056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:55 devstack sudo[74056]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:55 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:55 devstack cinder-volume[73068]: INFO cinder.volume.driver [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Driver hasn't implemented _init_vendor_properties() Apr 15 13:27:55 devstack cinder-volume[73068]: DEBUG cinder.volume.driver [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73068) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 13:27:55 devstack cinder-volume[73068]: DEBUG oslo_db.sqlalchemy.engines [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73068) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:27:55 devstack cinder-volume[73068]: DEBUG dbcounter [-] [73068] Writer thread running {{(pid=73068) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 13:27:55 devstack cinder-volume[73068]: DEBUG cinder.db.sqlalchemy.api [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Building query based on filter {{(pid=73068) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 13:27:55 devstack cinder-volume[73068]: DEBUG cinder.image.image_utils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73068) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 13:27:55 devstack cinder-volume[73068]: INFO cinder.keymgr.migration [None req-f5dc734a-8939-46cd-8487-c84e5c28bdd0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 13:27:55 devstack cinder-volume[73068]: DEBUG cinder.volume.drivers.lvm [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Updating volume stats {{(pid=73068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 13:27:55 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:55 devstack sudo[74061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 13:27:55 devstack sudo[74061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:55 devstack sudo[74061]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:55 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:55 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:55 devstack sudo[74064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:27:55 devstack sudo[74064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:56 devstack sudo[74064]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:56 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:56 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:56 devstack sudo[74067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:27:56 devstack sudo[74067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:56 devstack sudo[74067]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:56 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:56 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:56 devstack sudo[74075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:27:56 devstack sudo[74075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:56 devstack cinder-volume[72951]: DEBUG dbcounter [-] [72951] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72951) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:27:57 devstack sudo[74075]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:57 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:57 devstack cinder-volume[73068]: DEBUG cinder.manager [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Notifying Schedulers of capabilities ... {{(pid=73068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:27:57 devstack cinder-volume[73068]: INFO cinder.volume.manager [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Driver initialization completed successfully. Apr 15 13:27:57 devstack cinder-volume[73068]: INFO cinder.manager [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Initiating service 2 cleanup Apr 15 13:27:57 devstack cinder-volume[73068]: INFO cinder.manager [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Service 2 cleanup completed. Apr 15 13:27:57 devstack cinder-volume[73068]: DEBUG cinder.service [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Creating RPC server for service cinder-volume {{(pid=73068) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 13:27:57 devstack cinder-volume[73068]: DEBUG cinder.service [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73068) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 13:27:57 devstack cinder-volume[73068]: INFO cinder.volume.manager [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 15 13:27:57 devstack cinder-volume[73068]: DEBUG cinder.volume.drivers.lvm [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Updating volume stats {{(pid=73068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 13:27:57 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:57 devstack sudo[74081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 13:27:57 devstack sudo[74081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:57 devstack sudo[74081]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:57 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:57 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:57 devstack sudo[74086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:27:57 devstack sudo[74086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:58 devstack sudo[74086]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:58 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:58 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:58 devstack sudo[74089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:27:58 devstack sudo[74089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:58 devstack sudo[74089]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:58 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:58 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:27:58 devstack sudo[74232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:27:58 devstack sudo[74232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:27:59 devstack sudo[74232]: pam_unix(sudo:session): session closed for user root Apr 15 13:27:59 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:27:59 devstack cinder-volume[73068]: INFO cinder.volume.manager [None req-3fefa934-5229-48aa-97fc-73882c584bbd None None] Driver post RPC initialization completed successfully. Apr 15 13:28:09 devstack cinder-volume[73068]: DEBUG dbcounter [-] [73068] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73068) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:28:09 devstack cinder-volume[73068]: DEBUG dbcounter [-] [73068] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73068) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:29:18 devstack cinder-volume[73068]: DEBUG oslo_service.periodic_task [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:29:18 devstack cinder-volume[73068]: DEBUG cinder.volume.drivers.lvm [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Updating volume stats {{(pid=73068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 13:29:18 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:29:18 devstack sudo[79003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 13:29:18 devstack sudo[79003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:29:18 devstack sudo[79003]: pam_unix(sudo:session): session closed for user root Apr 15 13:29:18 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:29:18 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:29:18 devstack sudo[79011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:29:18 devstack sudo[79011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:29:18 devstack sudo[79011]: pam_unix(sudo:session): session closed for user root Apr 15 13:29:18 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:29:18 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:29:18 devstack sudo[79022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:29:18 devstack sudo[79022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:29:19 devstack sudo[79022]: pam_unix(sudo:session): session closed for user root Apr 15 13:29:19 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:29:19 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:29:19 devstack sudo[79028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:29:19 devstack sudo[79028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:29:19 devstack sudo[79028]: pam_unix(sudo:session): session closed for user root Apr 15 13:29:19 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:29:19 devstack cinder-volume[73068]: DEBUG cinder.manager [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Notifying Schedulers of capabilities ... {{(pid=73068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:30:09 devstack cinder-volume[73068]: DEBUG dbcounter [-] [73068] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73068) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:30:18 devstack cinder-volume[73068]: DEBUG oslo_service.periodic_task [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:30:18 devstack cinder-volume[73068]: DEBUG cinder.volume.drivers.lvm [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Updating volume stats {{(pid=73068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 13:30:18 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:30:18 devstack sudo[80911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 13:30:18 devstack sudo[80911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:30:18 devstack sudo[80911]: pam_unix(sudo:session): session closed for user root Apr 15 13:30:18 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:30:18 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:30:18 devstack sudo[80925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:30:18 devstack sudo[80925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:30:18 devstack sudo[80925]: pam_unix(sudo:session): session closed for user root Apr 15 13:30:18 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:30:18 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:30:18 devstack sudo[80928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 13:30:18 devstack sudo[80928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:30:19 devstack sudo[80928]: pam_unix(sudo:session): session closed for user root Apr 15 13:30:19 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.415s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:30:19 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:30:19 devstack sudo[80931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 13:30:19 devstack sudo[80931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:30:19 devstack sudo[80931]: pam_unix(sudo:session): session closed for user root Apr 15 13:30:19 devstack cinder-volume[73068]: DEBUG oslo_concurrency.processutils [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:30:19 devstack cinder-volume[73068]: DEBUG cinder.manager [None req-4de6ed1b-8b09-415e-9a24-57098e5a8f2d None None] Notifying Schedulers of capabilities ... {{(pid=73068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:31:10 devstack cinder-volume[72951]: INFO oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Caught SIGTERM, stopping children Apr 15 13:31:10 devstack cinder-volume[72951]: DEBUG oslo_concurrency.lockutils [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Acquiring lock "singleton_lock" {{(pid=72951) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 13:31:10 devstack cinder-volume[72951]: DEBUG oslo_concurrency.lockutils [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Acquired lock "singleton_lock" {{(pid=72951) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 13:31:10 devstack cinder-volume[72951]: DEBUG oslo_concurrency.lockutils [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Releasing lock "singleton_lock" {{(pid=72951) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 13:31:10 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Stop services. {{(pid=72951) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 13:31:10 devstack cinder-volume[72951]: DEBUG oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Killing children. {{(pid=72951) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 13:31:10 devstack cinder-volume[72951]: INFO oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Waiting on 1 children to exit Apr 15 13:31:12 devstack cinder-volume[73068]: DEBUG oslo_concurrency.lockutils [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Acquiring lock "singleton_lock" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 13:31:12 devstack cinder-volume[73068]: DEBUG oslo_concurrency.lockutils [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Acquired lock "singleton_lock" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 13:31:12 devstack cinder-volume[73068]: DEBUG oslo_concurrency.lockutils [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Releasing lock "singleton_lock" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 13:31:12 devstack cinder-volume[73068]: WARNING amqp [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 13:31:12 devstack cinder-volume[73068]: WARNING amqp [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 13:31:12 devstack cinder-volume[72951]: INFO oslo_service.backend._eventlet.service [None req-f0e18f8c-866d-44a2-93a7-a82d60f2b5cb None None] Child 73068 exited with status 0 Apr 15 13:31:12 devstack cinder-volume[82106]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 13:31:12 devstack cinder-volume[82106]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 13:31:12 devstack cinder-volume[82106]: we strongly recommend against using it for new projects. Apr 15 13:31:12 devstack cinder-volume[82106]: If you are already using Eventlet, we recommend migrating to a different Apr 15 13:31:12 devstack cinder-volume[82106]: framework. For more detail see Apr 15 13:31:12 devstack cinder-volume[82106]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 13:31:12 devstack cinder-volume[82106]: import eventlet # noqa Apr 15 13:31:14 devstack cinder-volume[82106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 13:31:14 devstack cinder-volume[82106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 13:31:14 devstack cinder-volume[82106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 13:31:14 devstack cinder-volume[82106]: INFO dbcounter [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Registered counter for database cinder Apr 15 13:31:14 devstack cinder-volume[82106]: DEBUG oslo_db.sqlalchemy.engines [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82106) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG dbcounter [-] [82106] Writer thread running {{(pid=82106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 13:31:15 devstack cinder-volume[82106]: INFO cinder.rpc [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 13:31:15 devstack cinder-volume[82106]: INFO cinder.rpc [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_db.sqlalchemy.engines [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82106) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:31:15 devstack cinder-volume[82106]: INFO cinder.volume.manager [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Determined volume DB was empty at startup. Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG cinder.volume.manager [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82106) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 13:31:15 devstack cinder-volume[82106]: INFO cinder.volume.manager [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 13:31:15 devstack cinder-volume[82106]: WARNING stevedore.named [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 13:31:15 devstack cinder-volume[82106]: WARNING castellan.key_manager [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 13:31:15 devstack cinder-volume[82106]: WARNING cinder.keymgr.conf_key_mgr [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 13:31:15 devstack cinder-volume[82106]: INFO cinder.volume.manager [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_db.sqlalchemy.engines [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82106) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:31:15 devstack cinder-volume[82106]: INFO oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Starting 1 workers Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Started child 82225 {{(pid=82106) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Full set of CONF: {{(pid=82106) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] ******************************************************************************** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Configuration options gathered from: {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 13:31:15 devstack cinder-volume[82225]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] ================================================================================ {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] allow_availability_zone_fallback = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] allow_compression_on_image_upload = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] allowed_direct_url_schemes = [] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] api_rate_limit = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] auth_strategy = keystone {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_availability_zone = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_host = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_name = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_stats_polling_interval = 60 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backup_api_class = cinder.backup.api.API {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backup_name_template = backup-%s {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backup_use_same_host = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backup_use_temp_snapshot = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] chap_password = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] chap_username = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cinder_internal_tenant_project_id = 08022539fc524e069f840e03002cf793 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cinder_internal_tenant_user_id = 2818a8ab4172488c9b51609b0c29ef14 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cluster = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] compression_format = gzip {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] compute_api_class = cinder.compute.nova.API {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] config_dir = [] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] config_source = [] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] control_exchange = openstack {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] debug = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] default_availability_zone = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] default_group_type = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] default_volume_type = QuobyteHD {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] disk_geometry = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] driver_client_cert = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] driver_client_cert_key = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] driver_data_namespace = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] driver_ssl_cert_path = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] driver_ssl_cert_verify = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] driver_use_ssl = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] enable_new_services = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] enable_unsupported_driver = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] enabled_backends = ['QuobyteHD'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] enforce_multipath_for_image_xfer = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] filter_function = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance_api_insecure = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance_api_servers = ['http://192.168.122.134/image'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance_api_ssl_compression = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance_ca_certificates_file = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance_catalog_info = image:glance:publicURL {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance_certfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82225]: INFO cinder.volume.manager [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance_keyfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance_num_retries = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance_request_timeout = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] goodness_function = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] graceful_shutdown_timeout = 5 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.remotefs [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82225) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] group_api_class = cinder.group.api.API {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] host = devstack {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] image_compress_on_upload = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] image_conversion_address_space_limit = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] image_conversion_cpu_limit = 60 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] image_conversion_disable = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] image_upload_use_cinder_backend = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] image_upload_use_internal_tenant = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] image_volume_cache_enabled = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] image_volume_cache_max_count = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] image_volume_cache_max_size_gb = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] init_host_max_objects_retrieval = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] instance_format = [instance: %(uuid)s] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] iscsi_target_flags = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] iscsi_write_cache = on {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] iser_helper = tgtadm {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] iser_ip_address = 192.168.122.134 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] iser_port = 3260 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] log_color = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] log_config_append = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] log_dir = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] log_file = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] log_options = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] log_rotate_interval = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] log_rotate_interval_type = days {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] log_rotation_type = none {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] max_age = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] max_logfile_count = 30 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] max_logfile_size_mb = 200 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] max_over_subscription_ratio = 20.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] message_reap_interval = 86400 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] message_ttl = 2592000 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] migration_create_volume_timeout_secs = 300 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] monkey_patch = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] monkey_patch_modules = [] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] my_ip = 192.168.122.134 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] no_snapshot_gb_quota = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] num_iser_scan_tries = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] num_shell_tries = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] num_volume_device_scan_tries = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] nvmeof_conn_info_version = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] nvmet_ns_id = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] nvmet_port_id = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] osapi_max_limit = 1000 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] osapi_volume_ext_list = [] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] osapi_volume_listen_port = 8776 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] osapi_volume_use_ssl = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] osapi_volume_workers = 2 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] per_volume_size_limit = -1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] periodic_fuzzy_delay = 60 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] periodic_interval = 60 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] public_endpoint = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] publish_errors = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] quota_backup_gigabytes = 1000 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] quota_backups = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] quota_gigabytes = 1000 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] quota_groups = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] quota_snapshots = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] quota_volumes = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] rate_limit_burst = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] rate_limit_except_level = CRITICAL {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] rate_limit_interval = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] reinit_driver_count = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] replication_device = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] report_discard_supported = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] report_interval = 120 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] reservation_clean_interval = 86400 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] reservation_expire = 86400 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] reserved_image_namespaces = [] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] reserved_percentage = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] rpc_response_timeout = 120 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] run_external_periodic_tasks = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] scst_target_driver = iscsi {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] scst_target_iqn_name = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_down_time = 720 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] shell_completion = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] snapshot_name_template = snapshot-%s {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] split_loggers = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] state_path = /opt/stack/data/cinder {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] storage_availability_zone = nova {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] storage_protocol = iSCSI {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] syslog_log_facility = LOG_USER {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] target_helper = lioadm {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] target_ip_address = 192.168.122.134 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] target_port = 3260 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] target_protocol = iscsi {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] target_secondary_ip_addresses = [] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] trace_flags = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] transport_url = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] until_refresh = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] use_chap_auth = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] use_default_quota_class = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] use_journal = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] use_json = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] use_multipath_for_image_xfer = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] use_stderr = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] use_syslog = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] verify_glance_signatures = enabled {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_api_class = cinder.volume.api.API {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_backend_name = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_clear = zero {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82225) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 13:31:15 devstack cinder-volume[82225]: WARNING cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 13:31:15 devstack cinder-volume[82225]: WARNING cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_clear_ionice = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_clear_size = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_copy_bps_limit = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Running cmd (subprocess): mount.quobyte {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_dd_blocksize = 1M {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_name_template = volume-%s {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_service_inithost_offload = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volume_usage_audit_period = month {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] zoning_mode = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_concurrency.disable_process_locking = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.admin_password = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.admin_token = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.admin_user = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.auth_port = 35357 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.auth_protocol = https {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.auth_section = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.auth_type = password {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.auth_uri = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.auth_version = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.cache = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.certfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.identity_uri = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.include_service_catalog = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.insecure = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.interface = public {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.keyfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_password = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcache_username = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.region_name = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.service_type = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.134/identity {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.backend = dogpile.cache.null {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.backend_argument = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.backend_expiration_time = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.config_prefix = cache.oslo {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.debug_cache_backend = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.enable_retry_client = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.enable_socket_keepalive = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.enabled = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.enforce_fips_mode = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.expiration_time = 600 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.hashclient_retry_attempts = 2 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.memcache_dead_retry = 300 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.memcache_pool_maxsize = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.memcache_sasl_enabled = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.password = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.proxies = [] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.redis_db = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.redis_server = localhost:6379 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.retry_attempts = 2 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.retry_delay = 0.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.socket_keepalive_count = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.socket_keepalive_idle = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.socket_keepalive_interval = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.socket_timeout = 1.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.tls_allowed_ciphers = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.tls_cafile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.tls_certfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.tls_enabled = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.tls_keyfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cache.username = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] coordination.backend_url = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.asyncio_connection = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.asyncio_slave_connection = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.backend = sqlalchemy {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.connection = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.connection_debug = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.connection_parameters = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.connection_recycle_time = 3600 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.connection_trace = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.db_inc_retry_interval = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.db_max_retries = 20 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.db_max_retry_interval = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.db_retry_interval = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.max_overflow = 50 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.max_pool_size = 5 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.max_retries = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.mysql_wsrep_sync_wait = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.pool_timeout = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.retry_interval = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.slave_connection = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.sqlite_synchronous = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.synchronous_reader = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] database.use_db_reconnect = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.connection_string = messaging:// {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.enabled = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack quobyte-client[82226]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 13:31:15 devstack quobyte-client[82226]: Invalid parameters found, error: missing mount point. Apr 15 13:31:15 devstack quobyte-client[82226]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 13:31:15 devstack quobyte-client[82226]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.es_doc_type = notification {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.es_scroll_size = 10000 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.es_scroll_time = 2m {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.filter_error_trace = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.hmac_keys = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.sentinel_service_name = mymaster {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.socket_timeout = 0.1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.trace_requests = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler.trace_sqlalchemy = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler_jaeger.process_tags = {} {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler_jaeger.service_name_prefix = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] profiler_otlp.service_name_prefix = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.enforce_new_defaults = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: WARNING oslo_config.cfg [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.enforce_scope = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.policy_default_rule = default {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.policy_file = policy.yaml {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] privsep_osbrick.group = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] privsep_osbrick.helper_command = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82225) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82225]: INFO cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e ... Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 -c /etc/quobyte/client-cinder.cfg {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] privsep_osbrick.user = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cinder_sys_admin.group = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cinder_sys_admin.helper_command = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] cinder_sys_admin.user = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_user.auth_section = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_user.auth_type = password {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_user.cafile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_user.certfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_user.collect_timing = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_user.insecure = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_user.keyfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_user.send_service_user_token = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_user.split_loggers = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] service_user.timeout = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance.auth_section = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance.auth_type = password {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance.certfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance.collect_timing = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance.insecure = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance.keyfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance.region_name = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance.split_loggers = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] glance.timeout = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.backend_availability_zone = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.chap_password = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.chap_username = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.disk_geometry = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.driver_client_cert = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.driver_client_cert_key = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.driver_data_namespace = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.driver_use_ssl = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack sudo[82227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 -c /etc/quobyte/client-cinder.cfg Apr 15 13:31:15 devstack sudo[82227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.extra_capabilities = {} {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.filter_function = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.goodness_function = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.iscsi_target_flags = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.iscsi_write_cache = on {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.iser_helper = tgtadm {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.iser_ip_address = 192.168.122.134 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.iser_port = 3260 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nas_host = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nas_login = admin {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nas_mount_options = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nas_password = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nas_private_key = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nas_share_path = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.num_shell_tries = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.quobyte_volume_url = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.replication_device = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.report_discard_supported = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.reserved_percentage = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.target_helper = tgtadm {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.target_ip_address = 192.168.122.134 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.target_port = 3260 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.target_protocol = iscsi {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.trace_flags = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.unique_fqdn_network = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.use_chap_auth = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.volume_backend_name = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.volume_clear = zero {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.volume_clear_ionice = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.volume_clear_size = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_reports.file_event_handler = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_reports.log_dir = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.backend_availability_zone = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.backend_host = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.chap_password = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.chap_username = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.chiscsi_conf = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.disk_geometry = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.driver_client_cert = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.driver_data_namespace = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.driver_use_ssl = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.extra_capabilities = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.filter_function = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.goodness_function = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.iser_helper = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.iser_ip_address = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.iser_port = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.iser_target_prefix = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nas_host = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nas_login = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nas_mount_options = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nas_password = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nas_private_key = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nas_share_path = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nas_ssh_port = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.num_shell_tries = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.nvmet_port_id = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.replication_device = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.report_discard_supported = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.reserved_percentage = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.scst_target_driver = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.storage_protocol = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.target_helper = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.target_ip_address = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.target_port = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.target_prefix = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.target_protocol = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.trace_flags = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.use_chap_auth = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.volume_clear = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.volume_clear_size = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] QuobyteHD.volumes_dir = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.ssl = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_notifications.driver = [] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_notifications.retry = -1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] key_manager.fixed_key = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.barbican_api_version = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.barbican_endpoint = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.barbican_endpoint_type = public {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.barbican_region_name = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.cafile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.certfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.collect_timing = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.insecure = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.keyfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.number_of_retries = 60 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.retry_delay = 1 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.send_service_user_token = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.split_loggers = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.timeout = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.verify_ssl = True {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican.verify_ssl_path = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican_service_user.auth_section = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican_service_user.auth_type = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican_service_user.cafile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican_service_user.certfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican_service_user.collect_timing = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican_service_user.insecure = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican_service_user.keyfile = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican_service_user.split_loggers = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] barbican_service_user.timeout = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.approle_role_id = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.approle_secret_id = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.kv_mountpoint = secret {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.kv_path = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.kv_version = 2 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.namespace = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.root_token_id = **** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.ssl_ca_crt_file = None {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.timeout = 60.0 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.use_ssl = False {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:15 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] ******************************************************************************** {{(pid=82106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 13:31:15 devstack sudo[82227]: pam_unix(sudo:session): session closed for user root Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.498s {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:15 devstack cinder-volume[82225]: INFO cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e succeeded Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82225) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.505s {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:31:15 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:15 devstack sudo[82296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:31:15 devstack sudo[82296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:31:16 devstack sudo[82296]: pam_unix(sudo:session): session closed for user root Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.396s {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:16 devstack cinder-volume[82225]: INFO cinder.volume.driver [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG cinder.volume.driver [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953468322754, 'free_capacity_gb': 1775.6953468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82225) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_db.sqlalchemy.engines [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG dbcounter [-] [82225] Writer thread running {{(pid=82225) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG cinder.db.sqlalchemy.api [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Building query based on filter {{(pid=82225) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG cinder.image.image_utils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82225) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 13:31:16 devstack cinder-volume[82225]: INFO cinder.keymgr.migration [None req-778a6805-bd11-4cf7-b908-68668e9cf900 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82225) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82225) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:16 devstack sudo[82299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:31:16 devstack sudo[82299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:31:16 devstack sudo[82299]: pam_unix(sudo:session): session closed for user root Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.398s {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG cinder.manager [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Notifying Schedulers of capabilities ... {{(pid=82225) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:31:16 devstack cinder-volume[82225]: INFO cinder.volume.manager [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Driver initialization completed successfully. Apr 15 13:31:16 devstack cinder-volume[82225]: INFO cinder.manager [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Initiating service 3 cleanup Apr 15 13:31:16 devstack cinder-volume[82225]: INFO cinder.manager [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Service 3 cleanup completed. Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG cinder.service [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Creating RPC server for service cinder-volume {{(pid=82225) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG cinder.service [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82225) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 13:31:16 devstack cinder-volume[82225]: INFO cinder.volume.manager [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82225) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82225) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:31:16 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:16 devstack sudo[82304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:31:16 devstack sudo[82304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:31:17 devstack sudo[82304]: pam_unix(sudo:session): session closed for user root Apr 15 13:31:17 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.399s {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:17 devstack cinder-volume[82225]: INFO cinder.volume.manager [None req-fa72c2e1-9304-4bd0-95bf-83d278fcaec7 None None] Driver post RPC initialization completed successfully. Apr 15 13:31:20 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-71001594-d404-4847-b060-ca6aa80e1d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:31:20 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-71001594-d404-4847-b060-ca6aa80e1d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:31:20 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-71001594-d404-4847-b060-ca6aa80e1d17 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82225) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:31:20 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-71001594-d404-4847-b060-ca6aa80e1d17 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82225) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:31:20 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-71001594-d404-4847-b060-ca6aa80e1d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:31:20 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-71001594-d404-4847-b060-ca6aa80e1d17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:20 devstack sudo[82371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:31:20 devstack sudo[82371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:31:20 devstack sudo[82371]: pam_unix(sudo:session): session closed for user root Apr 15 13:31:20 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-71001594-d404-4847-b060-ca6aa80e1d17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.381s {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:20 devstack cinder-volume[82225]: DEBUG cinder.manager [None req-71001594-d404-4847-b060-ca6aa80e1d17 None None] Notifying Schedulers of capabilities ... {{(pid=82225) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:31:24 devstack cinder-volume[82106]: INFO oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Caught SIGTERM, stopping children Apr 15 13:31:24 devstack cinder-volume[82106]: DEBUG oslo_concurrency.lockutils [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Acquiring lock "singleton_lock" {{(pid=82106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 13:31:24 devstack cinder-volume[82106]: DEBUG oslo_concurrency.lockutils [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Acquired lock "singleton_lock" {{(pid=82106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 13:31:24 devstack cinder-volume[82106]: DEBUG oslo_concurrency.lockutils [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Releasing lock "singleton_lock" {{(pid=82106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 13:31:24 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Stop services. {{(pid=82106) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 13:31:24 devstack cinder-volume[82106]: DEBUG oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Killing children. {{(pid=82106) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 13:31:24 devstack cinder-volume[82106]: INFO oslo_service.backend._eventlet.service [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Waiting on 1 children to exit Apr 15 13:31:27 devstack cinder-volume[82225]: DEBUG dbcounter [-] [82225] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82225) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:31:27 devstack cinder-volume[82225]: DEBUG dbcounter [-] [82225] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82225) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:31:28 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-8744b7a0-4ad1-459a-83c1-761f0a3e4b7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:31:28 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-8744b7a0-4ad1-459a-83c1-761f0a3e4b7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:31:28 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-8744b7a0-4ad1-459a-83c1-761f0a3e4b7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82225) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:31:28 devstack cinder-volume[82225]: DEBUG cinder.volume.drivers.quobyte [None req-8744b7a0-4ad1-459a-83c1-761f0a3e4b7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82225) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:31:28 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-8744b7a0-4ad1-459a-83c1-761f0a3e4b7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82225) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:31:28 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-8744b7a0-4ad1-459a-83c1-761f0a3e4b7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:28 devstack sudo[82464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:31:28 devstack sudo[82464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:31:28 devstack sudo[82464]: pam_unix(sudo:session): session closed for user root Apr 15 13:31:28 devstack cinder-volume[82225]: DEBUG oslo_concurrency.processutils [None req-8744b7a0-4ad1-459a-83c1-761f0a3e4b7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.430s {{(pid=82225) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:28 devstack cinder-volume[82225]: DEBUG cinder.manager [None req-8744b7a0-4ad1-459a-83c1-761f0a3e4b7c None None] Notifying Schedulers of capabilities ... {{(pid=82225) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:31:29 devstack cinder-volume[82225]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 15 13:31:29 devstack cinder-volume[82475]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 13:31:29 devstack cinder-volume[82475]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 13:31:29 devstack cinder-volume[82475]: we strongly recommend against using it for new projects. Apr 15 13:31:29 devstack cinder-volume[82475]: If you are already using Eventlet, we recommend migrating to a different Apr 15 13:31:29 devstack cinder-volume[82475]: framework. For more detail see Apr 15 13:31:29 devstack cinder-volume[82475]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 13:31:29 devstack cinder-volume[82475]: import eventlet # noqa Apr 15 13:31:30 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Acquiring lock "singleton_lock" {{(pid=82225) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 13:31:30 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Acquired lock "singleton_lock" {{(pid=82225) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 13:31:30 devstack cinder-volume[82225]: DEBUG oslo_concurrency.lockutils [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Releasing lock "singleton_lock" {{(pid=82225) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 13:31:30 devstack cinder-volume[82225]: WARNING amqp [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 13:31:30 devstack cinder-volume[82225]: WARNING amqp [None req-4506b9e1-9853-4ae6-adb0-d139fedac4d8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82475) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82475) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82475) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 13:31:31 devstack cinder-volume[82475]: INFO dbcounter [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Registered counter for database cinder Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_db.sqlalchemy.engines [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82475) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writer thread running {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 13:31:31 devstack cinder-volume[82475]: INFO cinder.rpc [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 13:31:31 devstack cinder-volume[82475]: INFO cinder.rpc [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_db.sqlalchemy.engines [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82475) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:31:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Determined volume DB was empty at startup. Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82475) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 13:31:31 devstack cinder-volume[82475]: WARNING stevedore.named [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 13:31:31 devstack cinder-volume[82475]: WARNING castellan.key_manager [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 13:31:31 devstack cinder-volume[82475]: WARNING cinder.keymgr.conf_key_mgr [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 13:31:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_db.sqlalchemy.engines [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82475) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:31:31 devstack cinder-volume[82475]: INFO oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Starting 1 workers Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Started child 82595 {{(pid=82475) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Full set of CONF: {{(pid=82475) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] ******************************************************************************** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Configuration options gathered from: {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] ================================================================================ {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] allow_availability_zone_fallback = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] allow_compression_on_image_upload = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] allowed_direct_url_schemes = [] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] api_rate_limit = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] auth_strategy = keystone {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_availability_zone = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82595]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_host = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_name = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_stats_polling_interval = 60 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backup_api_class = cinder.backup.api.API {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backup_name_template = backup-%s {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backup_use_same_host = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backup_use_temp_snapshot = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] chap_password = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] chap_username = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cinder_internal_tenant_project_id = 08022539fc524e069f840e03002cf793 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cinder_internal_tenant_user_id = 2818a8ab4172488c9b51609b0c29ef14 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cluster = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] compression_format = gzip {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] compute_api_class = cinder.compute.nova.API {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] config_dir = [] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] config_source = [] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] control_exchange = openstack {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] debug = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] default_availability_zone = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] default_group_type = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] default_volume_type = QuobyteHD {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] disk_geometry = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] driver_client_cert = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] driver_client_cert_key = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] driver_data_namespace = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] driver_ssl_cert_path = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] driver_ssl_cert_verify = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] driver_use_ssl = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] enable_new_services = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] enable_unsupported_driver = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] enabled_backends = ['QuobyteHD'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] enforce_multipath_for_image_xfer = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] filter_function = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance_api_insecure = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance_api_servers = ['http://192.168.122.134/image'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance_api_ssl_compression = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance_ca_certificates_file = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance_catalog_info = image:glance:publicURL {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance_certfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance_keyfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance_num_retries = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance_request_timeout = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] goodness_function = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] graceful_shutdown_timeout = 5 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] group_api_class = cinder.group.api.API {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] host = devstack {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] image_compress_on_upload = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] image_conversion_address_space_limit = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] image_conversion_cpu_limit = 60 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] image_conversion_disable = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] image_upload_use_cinder_backend = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] image_upload_use_internal_tenant = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] image_volume_cache_enabled = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] image_volume_cache_max_count = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] image_volume_cache_max_size_gb = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] init_host_max_objects_retrieval = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] instance_format = [instance: %(uuid)s] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] iscsi_target_flags = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] iscsi_write_cache = on {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] iser_helper = tgtadm {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] iser_ip_address = 192.168.122.134 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] iser_port = 3260 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] log_color = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] log_config_append = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] log_dir = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] log_file = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] log_options = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] log_rotate_interval = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] log_rotate_interval_type = days {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] log_rotation_type = none {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] max_age = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] max_logfile_count = 30 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] max_logfile_size_mb = 200 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] max_over_subscription_ratio = 20.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] message_reap_interval = 86400 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] message_ttl = 2592000 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] migration_create_volume_timeout_secs = 300 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] monkey_patch = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] monkey_patch_modules = [] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] my_ip = 192.168.122.134 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] no_snapshot_gb_quota = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] num_iser_scan_tries = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] num_shell_tries = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] num_volume_device_scan_tries = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] nvmeof_conn_info_version = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] nvmet_ns_id = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] nvmet_port_id = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] osapi_max_limit = 1000 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] osapi_volume_ext_list = [] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] osapi_volume_listen_port = 8776 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] osapi_volume_use_ssl = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] osapi_volume_workers = 2 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] per_volume_size_limit = -1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] periodic_fuzzy_delay = 60 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] periodic_interval = 60 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] public_endpoint = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] publish_errors = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] quota_backup_gigabytes = 1000 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] quota_backups = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] quota_gigabytes = 1000 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] quota_groups = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] quota_snapshots = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] quota_volumes = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] rate_limit_burst = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] rate_limit_except_level = CRITICAL {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] rate_limit_interval = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] reinit_driver_count = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82595) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] replication_device = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] report_discard_supported = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] report_interval = 120 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] reservation_clean_interval = 86400 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] reservation_expire = 86400 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] reserved_image_namespaces = [] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] reserved_percentage = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] rpc_response_timeout = 120 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] run_external_periodic_tasks = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] scst_target_driver = iscsi {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] scst_target_iqn_name = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_down_time = 720 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] shell_completion = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] snapshot_name_template = snapshot-%s {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] split_loggers = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] state_path = /opt/stack/data/cinder {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] storage_availability_zone = nova {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] storage_protocol = iSCSI {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] syslog_log_facility = LOG_USER {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] target_helper = lioadm {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] target_ip_address = 192.168.122.134 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] target_port = 3260 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] target_protocol = iscsi {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] target_secondary_ip_addresses = [] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] trace_flags = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] transport_url = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] until_refresh = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] use_chap_auth = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] use_default_quota_class = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] use_journal = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] use_json = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] use_multipath_for_image_xfer = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] use_stderr = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] use_syslog = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] verify_glance_signatures = enabled {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_api_class = cinder.volume.api.API {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_backend_name = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_clear = zero {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_clear_ionice = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_clear_size = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_copy_bps_limit = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_dd_blocksize = 1M {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_name_template = volume-%s {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_service_inithost_offload = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volume_usage_audit_period = month {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] zoning_mode = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_concurrency.disable_process_locking = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.admin_password = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.admin_token = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.admin_user = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.auth_port = 35357 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.auth_protocol = https {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.auth_section = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.auth_type = password {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.auth_uri = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.auth_version = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.cache = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.certfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.identity_uri = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.include_service_catalog = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.insecure = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.interface = public {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.keyfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_password = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcache_username = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.region_name = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.service_type = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.134/identity {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.backend = dogpile.cache.null {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.backend_argument = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.backend_expiration_time = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.config_prefix = cache.oslo {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.debug_cache_backend = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.enable_retry_client = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.enable_socket_keepalive = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.enabled = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.enforce_fips_mode = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.expiration_time = 600 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.hashclient_retry_attempts = 2 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.memcache_dead_retry = 300 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.memcache_pool_maxsize = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.memcache_sasl_enabled = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.password = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.proxies = [] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.redis_db = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.redis_server = localhost:6379 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.retry_attempts = 2 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.retry_delay = 0.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.socket_keepalive_count = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.socket_keepalive_idle = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.socket_keepalive_interval = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.socket_timeout = 1.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.tls_allowed_ciphers = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.tls_cafile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.tls_certfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.tls_enabled = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.tls_keyfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cache.username = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] coordination.backend_url = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.asyncio_connection = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.asyncio_slave_connection = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.backend = sqlalchemy {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.connection = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.connection_debug = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.connection_parameters = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.connection_recycle_time = 3600 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.connection_trace = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.db_inc_retry_interval = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.db_max_retries = 20 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.db_max_retry_interval = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.db_retry_interval = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.max_overflow = 50 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.max_pool_size = 5 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.max_retries = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.mysql_wsrep_sync_wait = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.pool_timeout = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.retry_interval = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.slave_connection = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.sqlite_synchronous = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.synchronous_reader = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] database.use_db_reconnect = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.connection_string = messaging:// {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.enabled = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.es_doc_type = notification {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.es_scroll_size = 10000 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.es_scroll_time = 2m {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.filter_error_trace = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.hmac_keys = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.sentinel_service_name = mymaster {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.socket_timeout = 0.1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.trace_requests = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler.trace_sqlalchemy = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler_jaeger.process_tags = {} {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler_jaeger.service_name_prefix = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] profiler_otlp.service_name_prefix = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.enforce_new_defaults = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: WARNING oslo_config.cfg [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.enforce_scope = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.policy_default_rule = default {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.policy_file = policy.yaml {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] privsep_osbrick.group = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] privsep_osbrick.helper_command = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] privsep_osbrick.user = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cinder_sys_admin.group = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cinder_sys_admin.helper_command = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] cinder_sys_admin.user = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_user.auth_section = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_user.auth_type = password {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_user.cafile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_user.certfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_user.collect_timing = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_user.insecure = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_user.keyfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_user.send_service_user_token = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_user.split_loggers = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] service_user.timeout = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance.auth_section = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance.auth_type = password {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance.certfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance.collect_timing = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance.insecure = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance.keyfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance.region_name = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance.split_loggers = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] glance.timeout = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.backend_availability_zone = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.chap_password = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.chap_username = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.disk_geometry = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.driver_client_cert = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.driver_client_cert_key = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.driver_data_namespace = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.driver_use_ssl = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.extra_capabilities = {} {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.filter_function = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.goodness_function = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.iscsi_target_flags = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.iscsi_write_cache = on {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.iser_helper = tgtadm {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.iser_ip_address = 192.168.122.134 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.iser_port = 3260 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82595) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.quobyte [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.quobyte [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nas_host = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nas_login = admin {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nas_mount_options = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nas_password = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nas_private_key = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Running cmd (subprocess): mount.quobyte {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nas_share_path = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.num_shell_tries = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.quobyte_volume_url = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.replication_device = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.report_discard_supported = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.reserved_percentage = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.target_helper = tgtadm {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.target_ip_address = 192.168.122.134 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.target_port = 3260 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.target_protocol = iscsi {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.trace_flags = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.unique_fqdn_network = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.use_chap_auth = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.volume_backend_name = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.volume_clear = zero {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.volume_clear_ionice = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.volume_clear_size = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_reports.file_event_handler = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_reports.log_dir = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.backend_availability_zone = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.backend_host = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.chap_password = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.chap_username = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.chiscsi_conf = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.disk_geometry = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.driver_client_cert = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.driver_data_namespace = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.driver_use_ssl = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.extra_capabilities = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.filter_function = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.goodness_function = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.iser_helper = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.iser_ip_address = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.iser_port = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.iser_target_prefix = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nas_host = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nas_login = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nas_mount_options = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nas_password = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nas_private_key = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nas_share_path = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nas_ssh_port = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.num_shell_tries = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.nvmet_port_id = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.replication_device = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.report_discard_supported = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.reserved_percentage = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.scst_target_driver = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.storage_protocol = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.target_helper = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.target_ip_address = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.target_port = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.target_prefix = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.target_protocol = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.trace_flags = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.use_chap_auth = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.volume_clear = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.volume_clear_size = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] QuobyteHD.volumes_dir = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:31 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.ssl = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_notifications.driver = [] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_notifications.retry = -1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] key_manager.fixed_key = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.barbican_api_version = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.barbican_endpoint = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.barbican_endpoint_type = public {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.barbican_region_name = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.cafile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.certfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.collect_timing = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.insecure = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.keyfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.number_of_retries = 60 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.retry_delay = 1 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.send_service_user_token = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.split_loggers = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.timeout = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.verify_ssl = True {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican.verify_ssl_path = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican_service_user.auth_section = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican_service_user.auth_type = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican_service_user.cafile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican_service_user.certfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican_service_user.collect_timing = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican_service_user.insecure = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican_service_user.keyfile = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican_service_user.split_loggers = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] barbican_service_user.timeout = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.approle_role_id = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.approle_secret_id = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.kv_mountpoint = secret {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.kv_path = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.kv_version = 2 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.namespace = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.root_token_id = **** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.ssl_ca_crt_file = None {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.timeout = 60.0 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.use_ssl = False {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 13:31:32 devstack cinder-volume[82475]: DEBUG oslo_service.backend._eventlet.service [None req-d5741aad-4f4c-4f74-b1ca-76f12f9a9796 None None] ******************************************************************************** {{(pid=82475) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 13:31:32 devstack quobyte-client[82601]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 13:31:32 devstack quobyte-client[82601]: Invalid parameters found, error: missing mount point. Apr 15 13:31:32 devstack quobyte-client[82601]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 13:31:32 devstack quobyte-client[82601]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:32 devstack sudo[82604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:31:32 devstack sudo[82604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:31:32 devstack sudo[82604]: pam_unix(sudo:session): session closed for user root Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.418s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:32 devstack cinder-volume[82595]: INFO cinder.volume.driver [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Driver hasn't implemented _init_vendor_properties() Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.volume.driver [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953468322754, 'free_capacity_gb': 1775.6953468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82595) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_db.sqlalchemy.engines [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82595) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writer thread running {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.db.sqlalchemy.api [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Building query based on filter {{(pid=82595) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82595) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:32 devstack cinder-volume[82595]: INFO cinder.keymgr.migration [None req-0e449cd6-e691-4371-b314-afb9d4072640 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 13:31:32 devstack sudo[82620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:31:32 devstack sudo[82620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:31:32 devstack sudo[82620]: pam_unix(sudo:session): session closed for user root Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.408s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:31:32 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Driver initialization completed successfully. Apr 15 13:31:32 devstack cinder-volume[82595]: INFO cinder.manager [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Initiating service 3 cleanup Apr 15 13:31:32 devstack cinder-volume[82595]: INFO cinder.manager [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Service 3 cleanup completed. Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.service [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Creating RPC server for service cinder-volume {{(pid=82595) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.service [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82595) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 13:31:32 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:31:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:31:33 devstack sudo[82678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:31:33 devstack sudo[82678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:31:33 devstack sudo[82678]: pam_unix(sudo:session): session closed for user root Apr 15 13:31:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.400s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:31:33 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6287086a-8e12-47c4-9e0b-dd0470e4072e None None] Driver post RPC initialization completed successfully. Apr 15 13:31:41 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:31:42 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:31:43 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=3 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:32:33 devstack cinder-volume[82595]: DEBUG oslo_service.periodic_task [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82595) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:32:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:32:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:32:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:32:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:32:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:32:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:32:33 devstack sudo[83262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:32:33 devstack sudo[83262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:32:34 devstack sudo[83262]: pam_unix(sudo:session): session closed for user root Apr 15 13:32:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 1.395s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:32:34 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:32:37 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:32:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Flow 'volume_create_manager' (06292045-b025-452f-a969-63278d5ef97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:32:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a116031e-7386-4023-9085-8be82423bd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a116031e-7386-4023-9085-8be82423bd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-97447626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fef5f8c-65f2-49cf-99fc-a412f7310d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e904fe1a1a40f9a32ef46acd7acab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:32:38Z,use_quota=True,user_id='d50498b6b6df42e5926af23d8e48f961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6021d8-90dc-4032-bfbf-23ab0cc49bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6021d8-90dc-4032-bfbf-23ab0cc49bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2371334b-08b2-4454-b482-e2e697687a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2371334b-08b2-4454-b482-e2e697687a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fef5f8c-65f2-49cf-99fc-a412f7310d2e', 'volume_name': 'volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e2d507-a19a-4cd1-a7bc-3d15197a1271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e2d507-a19a-4cd1-a7bc-3d15197a1271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cfa40c-5f94-444c-8502-b14f86d15d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:38 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Volume 9fef5f8c-65f2-49cf-99fc-a412f7310d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e', 'volume_size': 1} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-97447626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fef5f8c-65f2-49cf-99fc-a412f7310d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e904fe1a1a40f9a32ef46acd7acab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:32:38Z,use_quota=True,user_id='d50498b6b6df42e5926af23d8e48f961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Creating volume 9fef5f8c-65f2-49cf-99fc-a412f7310d2e {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:32:38 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:32:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:32:38 devstack sudo[83312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e 1073741824 Apr 15 13:32:38 devstack sudo[83312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:32:40 devstack sudo[83312]: pam_unix(sudo:session): session closed for user root Apr 15 13:32:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e 1073741824" returned: 0 in 2.059s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:32:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:32:40 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e Apr 15 13:32:40 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:32:40 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Apr 15 13:32:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e" returned: 0 in 0.598s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:32:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] <== create_volume: return (2728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:32:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.735s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:32:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cfa40c-5f94-444c-8502-b14f86d15d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab33c242-3b13-45aa-a16a-d85456aebd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:40 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Volume volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e (9fef5f8c-65f2-49cf-99fc-a412f7310d2e): created successfully Apr 15 13:32:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab33c242-3b13-45aa-a16a-d85456aebd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Flow 'volume_create_manager' (06292045-b025-452f-a969-63278d5ef97f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:32:40 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-d21c3bb9-e568-42ac-9ede-0ec83767c5bc tempest-VolumesAdminNegativeTest-640007293 None] Created volume successfully. Apr 15 13:32:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Acquiring lock "cinder-9fef5f8c-65f2-49cf-99fc-a412f7310d2e-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:32:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Lock "cinder-9fef5f8c-65f2-49cf-99fc-a412f7310d2e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:32:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Acquiring lock "cinder-quobyte-9fef5f8c-65f2-49cf-99fc-a412f7310d2e" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:32:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Lock "cinder-quobyte-9fef5f8c-65f2-49cf-99fc-a412f7310d2e" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:32:42 devstack cinder-volume[82595]: INFO oslo.privsep.daemon [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqskb4fh7/privsep.sock'] Apr 15 13:32:43 devstack sudo[83684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqskb4fh7/privsep.sock Apr 15 13:32:43 devstack sudo[83684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:32:43 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 15 13:32:43 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 13:32:43 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 13:32:43 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 13:32:43 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 13:32:43 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 13:32:43 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 13:32:43 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 13:32:43 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 15 13:32:44 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 15 13:32:44 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 13:32:44 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 13:32:44 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 13:32:44 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 13:32:44 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 13:32:44 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 13:32:44 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 13:32:44 devstack cinder-volume[82595]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 15 13:32:45 devstack sudo[83684]: pam_unix(sudo:session): session closed for user root Apr 15 13:32:45 devstack cinder-volume[82595]: INFO oslo.privsep.daemon [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Spawned new privsep daemon via rootwrap Apr 15 13:32:45 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Accepted privsep connection to /tmp/tmpqskb4fh7/privsep.sock {{(pid=82595) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 15 13:32:45 devstack cinder-volume[82595]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 15 13:32:45 devstack cinder-volume[82595]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 15 13:32:45 devstack cinder-volume[82595]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 15 13:32:45 devstack cinder-volume[82595]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83744 Apr 15 13:32:45 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[51324d7b-2329-4a27-be5d-396bf1d99466]: (2,) {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:32:45 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[0903435b-5260-4be0-b6de-ab616301431e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:32:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:32:45 devstack sudo[83746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e Apr 15 13:32:45 devstack sudo[83746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:32:46 devstack sudo[83746]: pam_unix(sudo:session): session closed for user root Apr 15 13:32:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e" returned: 0 in 1.420s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:32:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:32:46 devstack sudo[83752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e Apr 15 13:32:46 devstack sudo[83752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Flow 'volume_create_manager' (205a9e9b-e684-404f-9463-c0a86382b922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc4876c-47b5-4f56-a062-899f720379ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc4876c-47b5-4f56-a062-899f720379ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-965563053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6398dadc34fc4748968397ae98fd60f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:32:47Z,use_quota=True,user_id='65221c3d3efd4bc4934a944f614cdacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2233572e-dea6-479c-ae05-eeacf77853f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2233572e-dea6-479c-ae05-eeacf77853f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b058d4b-7531-46f7-b734-bb60a4fb9f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b058d4b-7531-46f7-b734-bb60a4fb9f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0', 'volume_name': 'volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc9021d-7d83-4c35-9126-2168ee4f35a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc9021d-7d83-4c35-9126-2168ee4f35a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37457440-8489-4090-93af-4bf372fcac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:47 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Volume 96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0', 'volume_size': 1} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-965563053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6398dadc34fc4748968397ae98fd60f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:32:47Z,use_quota=True,user_id='65221c3d3efd4bc4934a944f614cdacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Creating volume 96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:32:47 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:32:47 devstack sudo[83755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 1073741824 Apr 15 13:32:47 devstack sudo[83755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:32:47 devstack sudo[83752]: pam_unix(sudo:session): session closed for user root Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9fef5f8c-65f2-49cf-99fc-a412f7310d2e" returned: 0 in 1.184s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Lock "cinder-quobyte-9fef5f8c-65f2-49cf-99fc-a412f7310d2e" released by "delete_volume" :: held 4.846s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:32:47 devstack cinder-volume[82595]: WARNING cinder.quota [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:32:47 devstack cinder-volume[82595]: WARNING cinder.quota [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:32:47 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Created reservations ['94221872-f4cf-45ab-9ed6-c6581f7225cc', '0309a53c-5231-447e-bfa3-13df94a99a6a', 'cb6e50d3-aa29-4b1d-a0e2-b18059dedaee', '3d87d357-cc53-4596-a5d1-a50413eaeceb'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:32:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:32:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:32:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:32:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:32:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:32:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:32:48 devstack sudo[83759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:32:48 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:32:48 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root Apr 15 13:32:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.934s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:32:48 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:32:48 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Deleted volume successfully. Apr 15 13:32:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-766ce843-3280-4a5e-9c55-d9cd14d4eeb4 tempest-VolumesAdminNegativeTest-640007293 None] Lock "cinder-9fef5f8c-65f2-49cf-99fc-a412f7310d2e-delete_volume" released by "delete_volume" :: held 6.119s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:32:49 devstack sudo[83755]: pam_unix(sudo:session): session closed for user root Apr 15 13:32:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 1073741824" returned: 0 in 2.226s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:32:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:32:49 devstack sudo[83767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 Apr 15 13:32:49 devstack sudo[83767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:32:50 devstack sudo[83767]: pam_unix(sudo:session): session closed for user root Apr 15 13:32:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0" returned: 0 in 0.798s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:32:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] <== create_volume: return (3070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:32:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.074s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:32:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37457440-8489-4090-93af-4bf372fcac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c837c9-d725-4f0d-a060-b7b6adcb6396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:32:50 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Volume volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 (96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0): created successfully Apr 15 13:32:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c837c9-d725-4f0d-a060-b7b6adcb6396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:32:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Flow 'volume_create_manager' (205a9e9b-e684-404f-9463-c0a86382b922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:32:50 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2fa35950-72be-4a5b-ab59-9c89478ed6a6 tempest-ServerRescueNegativeTestJSON-151325477 None] Created volume successfully. Apr 15 13:33:00 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:33:00 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=11,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Flow 'volume_create_manager' (81b79c15-c2a6-42ba-a51e-9c1efe1f5466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f608fc-85df-4038-b6b9-0252a0222ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f608fc-85df-4038-b6b9-0252a0222ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:33:01Z,deleted=False,deleted_at=None,display_description='',display_name='537bd4f7-028a-48e8-92a9-2d34a5e28624-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa136b2-2d0f-4baf-bb4a-2892615e301e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69fbaccf20f49fea971b9a730661016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:33:02Z,use_quota=True,user_id='ee58ebb42d47475c8a62d8754facd5a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d76d7d6-6942-417c-ac47-4c6da3ce8d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d76d7d6-6942-417c-ac47-4c6da3ce8d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6d3121-5efd-4398-8626-b37c7f3a000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6d3121-5efd-4398-8626-b37c7f3a000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa136b2-2d0f-4baf-bb4a-2892615e301e', 'volume_name': 'volume-caa136b2-2d0f-4baf-bb4a-2892615e301e', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10f0ef9-a1d2-4714-9ab1-4eb355afe9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10f0ef9-a1d2-4714-9ab1-4eb355afe9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b355b231-2345-475c-ae1e-d69ba11370e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:02 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Volume caa136b2-2d0f-4baf-bb4a-2892615e301e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa136b2-2d0f-4baf-bb4a-2892615e301e', 'volume_size': 1} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:33:01Z,deleted=False,deleted_at=None,display_description='',display_name='537bd4f7-028a-48e8-92a9-2d34a5e28624-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa136b2-2d0f-4baf-bb4a-2892615e301e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69fbaccf20f49fea971b9a730661016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:33:02Z,use_quota=True,user_id='ee58ebb42d47475c8a62d8754facd5a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Creating volume caa136b2-2d0f-4baf-bb4a-2892615e301e {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:33:02 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:33:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:02 devstack sudo[83884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e 1073741824 Apr 15 13:33:02 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:04 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e 1073741824" returned: 0 in 1.819s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:04 devstack sudo[83894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e Apr 15 13:33:04 devstack sudo[83894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:05 devstack sudo[83894]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e" returned: 0 in 0.844s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] <== create_volume: return (2716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:33:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.719s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b355b231-2345-475c-ae1e-d69ba11370e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa136b2-2d0f-4baf-bb4a-2892615e301e', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985da43f-fd62-4552-ba00-d6a61c29401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:05 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Volume volume-caa136b2-2d0f-4baf-bb4a-2892615e301e (caa136b2-2d0f-4baf-bb4a-2892615e301e): created successfully Apr 15 13:33:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985da43f-fd62-4552-ba00-d6a61c29401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Flow 'volume_create_manager' (81b79c15-c2a6-42ba-a51e-9c1efe1f5466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:33:05 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-40c8177c-840e-4458-9b48-9def0a486d18 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Created volume successfully. Apr 15 13:33:12 devstack cinder-volume[82595]: WARNING py.warnings [req-fc817862-7af3-4624-b81d-eaa046f5eace req-0a207bab-1dbc-4b26-87cb-64318525777f tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 15 13:33:12 devstack cinder-volume[82595]: .first() Apr 15 13:33:12 devstack cinder-volume[82595]: Apr 15 13:33:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-0a207bab-1dbc-4b26-87cb-64318525777f tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-0a207bab-1dbc-4b26-87cb-64318525777f tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:12 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d4d5ff-2ba0-42af-bbc0-f6b50196522c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:33:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-0a207bab-1dbc-4b26-87cb-64318525777f tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:12 devstack sudo[83998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e Apr 15 13:33:12 devstack sudo[83998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Acquiring lock "cinder-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:33:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Lock "cinder-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:33:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Acquiring lock "cinder-quobyte-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:33:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Lock "cinder-quobyte-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:33:13 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca701554-7469-414f-b515-9ab8ce0bcf48]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:33:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:13 devstack sudo[84003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 Apr 15 13:33:13 devstack sudo[84003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:13 devstack sudo[83998]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-0a207bab-1dbc-4b26-87cb-64318525777f tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e" returned: 0 in 1.272s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-fc817862-7af3-4624-b81d-eaa046f5eace req-0a207bab-1dbc-4b26-87cb-64318525777f tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.322s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-0a207bab-1dbc-4b26-87cb-64318525777f tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e', 'name': 'volume-caa136b2-2d0f-4baf-bb4a-2892615e301e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b8dde3c-e8f2-4a48-8746-aa2f31d2c823', 'enforce_multipath': True} {{(pid=82595) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 13:33:14 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-fc817862-7af3-4624-b81d-eaa046f5eace req-0a207bab-1dbc-4b26-87cb-64318525777f tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] attachment_update completed successfully. Apr 15 13:33:14 devstack sudo[84003]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0" returned: 0 in 0.890s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:14 devstack sudo[84014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0 Apr 15 13:33:14 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:15 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0" returned: 0 in 1.072s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:15 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Lock "cinder-quobyte-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0" released by "delete_volume" :: held 2.014s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:33:15 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Created reservations ['e53ee036-2f5a-4700-9e01-98844ccd4ed3', '1ee8b594-af69-4095-8fab-a96a6879f39d', '3d8376d4-b470-4446-a4be-e75b5af902df', '4584d747-a7b6-4302-a268-e0a483813cb2'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:33:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:33:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:33:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:15 devstack sudo[84017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:33:15 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:16 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 1.508s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:16 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:33:16 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Deleted volume successfully. Apr 15 13:33:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bf932eeb-dd81-4610-97c9-59a2d8c22133 tempest-ServerRescueNegativeTestJSON-151325477 None] Lock "cinder-96fa625e-8d37-44b9-9e14-9c6d7cd2b4c0-delete_volume" released by "delete_volume" :: held 3.875s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Flow 'volume_create_manager' (30d62db7-c8e5-4932-ad91-32139557852f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8c6d96-af84-4d29-a1b1-f329c15adf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8c6d96-af84-4d29-a1b1-f329c15adf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1956706359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe8132e-804d-4a84-b4eb-10d1327fa7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9ce81971c1a45539395680ea1f2b786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:33:20Z,use_quota=True,user_id='e979b906e3264b36a977a1f04f1b6326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c19e872-c458-49d8-8b0a-c1ef23c432da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c19e872-c458-49d8-8b0a-c1ef23c432da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b4d107-fa8d-45a5-967e-1f59f0c2b43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b4d107-fa8d-45a5-967e-1f59f0c2b43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe8132e-804d-4a84-b4eb-10d1327fa7b8', 'volume_name': 'volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3178649a-9ad8-4b71-a687-a6b71fd1bf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3178649a-9ad8-4b71-a687-a6b71fd1bf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b94c741-1a19-471f-b5a2-9da2becac232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:20 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Volume ebe8132e-804d-4a84-b4eb-10d1327fa7b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8', 'volume_size': 1} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1956706359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe8132e-804d-4a84-b4eb-10d1327fa7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9ce81971c1a45539395680ea1f2b786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:33:20Z,use_quota=True,user_id='e979b906e3264b36a977a1f04f1b6326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Creating volume ebe8132e-804d-4a84-b4eb-10d1327fa7b8 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:33:20 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:33:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:20 devstack sudo[84504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 1073741824 Apr 15 13:33:20 devstack sudo[84504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:22 devstack sudo[84504]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 1073741824" returned: 0 in 1.823s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:22 devstack sudo[84512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 Apr 15 13:33:22 devstack sudo[84512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:23 devstack sudo[84512]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8" returned: 0 in 0.872s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] <== create_volume: return (2739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:33:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.744s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b94c741-1a19-471f-b5a2-9da2becac232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167adf9f-f8f0-4bca-8624-f15368345b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:23 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Volume volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 (ebe8132e-804d-4a84-b4eb-10d1327fa7b8): created successfully Apr 15 13:33:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167adf9f-f8f0-4bca-8624-f15368345b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Flow 'volume_create_manager' (30d62db7-c8e5-4932-ad91-32139557852f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:33:23 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-5516a1ca-8aa4-408b-ad92-56e7b8c058d1 tempest-DeleteServersTestJSON-994851499 None] Created volume successfully. Apr 15 13:33:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-aa2162ce-1ac9-4e36-b35c-2f272a107046 req-73d7d39d-6c81-4b7a-ac1a-d1efe024628f tempest-DeleteServersTestJSON-994851499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-aa2162ce-1ac9-4e36-b35c-2f272a107046 req-73d7d39d-6c81-4b7a-ac1a-d1efe024628f tempest-DeleteServersTestJSON-994851499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:27 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2167dd-c54d-4d43-b4ea-9556e9f40acd]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:33:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-aa2162ce-1ac9-4e36-b35c-2f272a107046 req-73d7d39d-6c81-4b7a-ac1a-d1efe024628f tempest-DeleteServersTestJSON-994851499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:27 devstack sudo[84562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 Apr 15 13:33:27 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:28 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-aa2162ce-1ac9-4e36-b35c-2f272a107046 req-73d7d39d-6c81-4b7a-ac1a-d1efe024628f tempest-DeleteServersTestJSON-994851499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8" returned: 0 in 0.651s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-aa2162ce-1ac9-4e36-b35c-2f272a107046 req-73d7d39d-6c81-4b7a-ac1a-d1efe024628f tempest-DeleteServersTestJSON-994851499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.674s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-aa2162ce-1ac9-4e36-b35c-2f272a107046 req-73d7d39d-6c81-4b7a-ac1a-d1efe024628f tempest-DeleteServersTestJSON-994851499 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e', 'name': 'volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '859e2bb1-55d2-426b-97f1-875f35423498', 'enforce_multipath': True} {{(pid=82595) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 13:33:28 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-aa2162ce-1ac9-4e36-b35c-2f272a107046 req-73d7d39d-6c81-4b7a-ac1a-d1efe024628f tempest-DeleteServersTestJSON-994851499 None] attachment_update completed successfully. Apr 15 13:33:33 devstack cinder-volume[82595]: DEBUG oslo_service.periodic_task [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82595) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:33:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:33:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:33:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:33 devstack sudo[84631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:33:33 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:34 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.695s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:34 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:33:36 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-b4510e03-713b-4d07-8a8a-d5f0265c1850 req-670da6e9-1a86-4340-af49-2fb35c8c457a tempest-DeleteServersTestJSON-994851499 None] Terminate volume connection completed successfully. Apr 15 13:33:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-b4510e03-713b-4d07-8a8a-d5f0265c1850 req-670da6e9-1a86-4340-af49-2fb35c8c457a tempest-DeleteServersTestJSON-994851499 None] Deleting attachment 859e2bb1-55d2-426b-97f1-875f35423498. {{(pid=82595) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 13:33:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Acquiring lock "cinder-ebe8132e-804d-4a84-b4eb-10d1327fa7b8-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:33:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Lock "cinder-ebe8132e-804d-4a84-b4eb-10d1327fa7b8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:33:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Acquiring lock "cinder-quobyte-ebe8132e-804d-4a84-b4eb-10d1327fa7b8" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:33:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Lock "cinder-quobyte-ebe8132e-804d-4a84-b4eb-10d1327fa7b8" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:33:42 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[6067a57d-ac59-4076-b376-82a1894e6871]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:33:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:42 devstack sudo[84794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 Apr 15 13:33:42 devstack sudo[84794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:43 devstack sudo[84794]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8" returned: 0 in 0.593s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:43 devstack sudo[84799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8 Apr 15 13:33:43 devstack sudo[84799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:43 devstack sudo[84799]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ebe8132e-804d-4a84-b4eb-10d1327fa7b8" returned: 0 in 0.484s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Lock "cinder-quobyte-ebe8132e-804d-4a84-b4eb-10d1327fa7b8" released by "delete_volume" :: held 1.120s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Created reservations ['0a5ced3c-bd3a-4c04-a0b3-08cd9f96aad6', '8a06e3e0-0ed6-4bca-be11-eb810fe90e08', '3049adb2-f362-4f22-bfb1-85ef41001445', 'dbce27f2-7647-4e19-8575-e7c6ab3debed'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:43 devstack sudo[84802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:33:43 devstack sudo[84802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:43 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-53c8fb5e-5c3d-4e90-8d48-3efc16dcc615 tempest-GroupsV314Test-521774702 None] Group tempest-GroupsV314Test-Group-2054496569: creating Apr 15 13:33:43 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-53c8fb5e-5c3d-4e90-8d48-3efc16dcc615 tempest-GroupsV314Test-521774702 None] Group tempest-GroupsV314Test-Group-2054496569: created successfully Apr 15 13:33:43 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-53c8fb5e-5c3d-4e90-8d48-3efc16dcc615 tempest-GroupsV314Test-521774702 None] Create group completed successfully. Apr 15 13:33:44 devstack sudo[84802]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.547s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:44 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:33:44 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Deleted volume successfully. Apr 15 13:33:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-252a792c-65ce-48db-970c-2af68d6d0e4a tempest-DeleteServersTestJSON-994851499 None] Lock "cinder-ebe8132e-804d-4a84-b4eb-10d1327fa7b8-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Flow 'volume_create_manager' (d2bcde9d-12c7-4078-8c96-0ac4b91209ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b151a29-3c87-4598-848a-c57eced78404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b151a29-3c87-4598-848a-c57eced78404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-991584942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2883798f-2891-4ec1-b62b-3cf8df5e3a1b,host='devstack@QuobyteHD#QuobyteHD',id=252e8fab-6499-49b5-b209-80d1e216a6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595e728a2dd24bb1a0f9a98c7a4db4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:33:45Z,use_quota=True,user_id='fc77835738d542bfa13cfff7786149a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50afc36d-a363-48fa-90c2-5b217fe78445),volume_type_id=50afc36d-a363-48fa-90c2-5b217fe78445)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ce1aa4-af9b-4b04-9a58-2357f2caf75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ce1aa4-af9b-4b04-9a58-2357f2caf75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acaf5200-56d2-4710-a2ab-4b47a8c28856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acaf5200-56d2-4710-a2ab-4b47a8c28856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252e8fab-6499-49b5-b209-80d1e216a6ce', 'volume_name': 'volume-252e8fab-6499-49b5-b209-80d1e216a6ce', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8627c35d-3fd5-4132-ac7d-c9f0bce560c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8627c35d-3fd5-4132-ac7d-c9f0bce560c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6815e14a-07c1-42f7-9690-39a2d02a7c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:45 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Volume 252e8fab-6499-49b5-b209-80d1e216a6ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252e8fab-6499-49b5-b209-80d1e216a6ce', 'volume_size': 1} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2883798f-2891-4ec1-b62b-3cf8df5e3a1b,created_at=2026-04-15T11:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-991584942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2883798f-2891-4ec1-b62b-3cf8df5e3a1b,host='devstack@QuobyteHD#QuobyteHD',id=252e8fab-6499-49b5-b209-80d1e216a6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595e728a2dd24bb1a0f9a98c7a4db4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:33:45Z,use_quota=True,user_id='fc77835738d542bfa13cfff7786149a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50afc36d-a363-48fa-90c2-5b217fe78445),volume_type_id=50afc36d-a363-48fa-90c2-5b217fe78445)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Creating volume 252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:33:45 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:33:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:45 devstack sudo[84814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce 1073741824 Apr 15 13:33:45 devstack sudo[84814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:46 devstack sudo[84814]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce 1073741824" returned: 0 in 0.966s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:46 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce Apr 15 13:33:46 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:46 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce" returned: 0 in 0.507s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:33:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6815e14a-07c1-42f7-9690-39a2d02a7c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252e8fab-6499-49b5-b209-80d1e216a6ce', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53724a1b-19ae-4f7d-922a-8a61497d0a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:46 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Volume volume-252e8fab-6499-49b5-b209-80d1e216a6ce (252e8fab-6499-49b5-b209-80d1e216a6ce): created successfully Apr 15 13:33:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53724a1b-19ae-4f7d-922a-8a61497d0a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Flow 'volume_create_manager' (d2bcde9d-12c7-4078-8c96-0ac4b91209ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:33:46 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c6a438d4-5c45-46cd-bdf3-44c37b98cb42 tempest-GroupsV314Test-521774702 None] Created volume successfully. Apr 15 13:33:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:48 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Cloning volume 252e8fab-6499-49b5-b209-80d1e216a6ce to volume fa2dc0fb-8db6-48d7-a345-9005a1f059de Apr 15 13:33:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Creating offline snapshot f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 of volume 252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:33:48 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e639d59-07a0-4010-81dc-a01e8deca496]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:33:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:48 devstack sudo[84887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce Apr 15 13:33:48 devstack sudo[84887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:49 devstack sudo[84887]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce" returned: 0 in 0.767s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:49 devstack sudo[84896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 1G Apr 15 13:33:49 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:50 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 1G" returned: 0 in 1.036s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252e8fab-6499-49b5-b209-80d1e216a6ce -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:50 devstack sudo[84942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252e8fab-6499-49b5-b209-80d1e216a6ce -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 Apr 15 13:33:50 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:51 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252e8fab-6499-49b5-b209-80d1e216a6ce -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1" returned: 0 in 0.799s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:51 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:51 devstack sudo[84947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 Apr 15 13:33:51 devstack sudo[84947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Flow 'volume_create_manager' (762e83a2-3c9c-450e-9ac7-5554111b6dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af01414-2042-4432-a6e2-9103cb0f7a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af01414-2042-4432-a6e2-9103cb0f7a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-135661072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662d25ed-086a-4551-84a2-33fb3582e7f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfbac872af1942a4a8c46e49551ec393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:33:51Z,use_quota=True,user_id='42346e8630984f87bce1c2830c34b58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa08ef5-3f59-4b97-908a-1c57611476c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa08ef5-3f59-4b97-908a-1c57611476c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796a5b4a-cf21-4984-9dfa-61b8d7008018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796a5b4a-cf21-4984-9dfa-61b8d7008018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662d25ed-086a-4551-84a2-33fb3582e7f8', 'volume_name': 'volume-662d25ed-086a-4551-84a2-33fb3582e7f8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4e6f06-5ac3-4b41-94df-4f58137dd833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4e6f06-5ac3-4b41-94df-4f58137dd833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c68a64-69e1-4f7a-bfbc-8bc9f17a406e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:33:51 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Volume 662d25ed-086a-4551-84a2-33fb3582e7f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662d25ed-086a-4551-84a2-33fb3582e7f8', 'volume_size': 1} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:51 devstack sudo[84947]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1" returned: 0 in 0.561s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:51 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.info Apr 15 13:33:51 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:52 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.info" returned: 0 in 0.459s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:52 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:52 devstack sudo[84954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.info Apr 15 13:33:52 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:52 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.info" returned: 0 in 0.605s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Acquiring lock "cinder-quobyte-fa2dc0fb-8db6-48d7-a345-9005a1f059de" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Lock "cinder-quobyte-fa2dc0fb-8db6-48d7-a345-9005a1f059de" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] snapshot: f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1, volume: fa2dc0fb-8db6-48d7-a345-9005a1f059de, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ade9084-6bb0-49c1-8435-c7b01272eea3]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:33:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:52 devstack sudo[84958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 Apr 15 13:33:52 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:53 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1" returned: 0 in 0.737s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252e8fab-6499-49b5-b209-80d1e216a6ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:33:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:33:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:33:53 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d788923-ab8e-44a1-9d90-3e2b21109d0f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:33:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:53 devstack sudo[84964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce Apr 15 13:33:53 devstack sudo[84964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:54 devstack sudo[84964]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce" returned: 0 in 0.820s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:54 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:33:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:54 devstack sudo[84969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de Apr 15 13:33:54 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:58 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de" returned: 0 in 4.459s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:58 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f72736-0793-4b4a-b1a3-c4ac73195e7d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:33:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:59 devstack sudo[85033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce Apr 15 13:33:59 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:33:59 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root Apr 15 13:33:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce" returned: 0 in 0.729s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:33:59 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:33:59 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Converted 1024.00 MB image at 229.58 MB/s Apr 15 13:33:59 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:33:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:33:59 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de Apr 15 13:33:59 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:00 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de" returned: 0 in 0.573s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Lock "cinder-quobyte-fa2dc0fb-8db6-48d7-a345-9005a1f059de" released by "_copy_volume_from_snapshot" :: held 7.406s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Acquiring lock "cinder-quobyte-f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Lock "cinder-quobyte-f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Deleting offline snapshot f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 of volume 252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:34:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] snapshot_file for this snap is: volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:34:00 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c29f9-f319-4563-b3bd-29582cd22682]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:00 devstack sudo[85048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 Apr 15 13:34:00 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:00 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1" returned: 0 in 0.606s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252e8fab-6499-49b5-b209-80d1e216a6ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:01 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da7d7d8-86f8-4c86-b9d6-d1badfc27750]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:01 devstack sudo[85053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce Apr 15 13:34:01 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:01 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:UPDATE=28,cinder:SELECT=36,cinder:INSERT=4,cinder:DELETE=4 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:34:01 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce" returned: 0 in 0.899s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:01 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 Apr 15 13:34:01 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:02 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1" returned: 0 in 0.964s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:02 devstack sudo[85105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1 Apr 15 13:34:02 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:03 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce.f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1" returned: 0 in 0.580s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Lock "cinder-quobyte-f98d3155-ff42-45c5-ab09-a6d8c8bb4ce1" released by "_delete_snapshot" :: held 3.187s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=37,cinder:UPDATE=35,cinder:INSERT=9,cinder:DELETE=1 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.028s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.046s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-135661072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662d25ed-086a-4551-84a2-33fb3582e7f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfbac872af1942a4a8c46e49551ec393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:33:51Z,use_quota=True,user_id='42346e8630984f87bce1c2830c34b58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Creating volume 662d25ed-086a-4551-84a2-33fb3582e7f8 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:03 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:03 devstack sudo[85108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8 1073741824 Apr 15 13:34:03 devstack sudo[85108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:03 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0dd36121-917b-4693-8215-d02633ef0614 tempest-GroupsV314Test-521774702 None] Create group from source-group-2883798f-2891-4ec1-b62b-3cf8df5e3a1b completed successfully. Apr 15 13:34:04 devstack sudo[85108]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8 1073741824" returned: 0 in 0.911s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:04 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8 Apr 15 13:34:04 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:05 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8" returned: 0 in 0.579s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c68a64-69e1-4f7a-bfbc-8bc9f17a406e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662d25ed-086a-4551-84a2-33fb3582e7f8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82269e6-dd24-437b-92b0-4e1b152148f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:05 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Volume volume-662d25ed-086a-4551-84a2-33fb3582e7f8 (662d25ed-086a-4551-84a2-33fb3582e7f8): created successfully Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82269e6-dd24-437b-92b0-4e1b152148f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Flow 'volume_create_manager' (762e83a2-3c9c-450e-9ac7-5554111b6dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:05 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-2f6af38a-66ba-4077-8986-4f74d566a41f req-8988e309-4a44-4daf-acb2-70ac15339661 tempest-VolumesGetTestJSON-1357433742 None] Created volume successfully. Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Acquiring lock "cinder-quobyte-fa2dc0fb-8db6-48d7-a345-9005a1f059de" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Lock "cinder-quobyte-fa2dc0fb-8db6-48d7-a345-9005a1f059de" acquired by "delete_volume" :: waited 0.027s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf9c547-061f-455b-a976-dfff6ce9d193]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:05 devstack sudo[85118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de Apr 15 13:34:05 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Acquiring lock "cinder-662d25ed-086a-4551-84a2-33fb3582e7f8-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Lock "cinder-662d25ed-086a-4551-84a2-33fb3582e7f8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Acquiring lock "cinder-quobyte-662d25ed-086a-4551-84a2-33fb3582e7f8" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Lock "cinder-quobyte-662d25ed-086a-4551-84a2-33fb3582e7f8" acquired by "delete_volume" :: waited 0.031s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce3920e-5e0e-4820-94ac-48f7f61ec81f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:05 devstack sudo[85121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8 Apr 15 13:34:05 devstack sudo[85121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:06 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de" returned: 0 in 1.089s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:06 devstack sudo[85127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de Apr 15 13:34:06 devstack sudo[85127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:06 devstack sudo[85121]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8" returned: 0 in 1.045s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:06 devstack sudo[85146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8 Apr 15 13:34:06 devstack sudo[85146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:07 devstack sudo[85127]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fa2dc0fb-8db6-48d7-a345-9005a1f059de" returned: 0 in 0.772s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Lock "cinder-quobyte-fa2dc0fb-8db6-48d7-a345-9005a1f059de" released by "delete_volume" :: held 1.951s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:07 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Created reservations ['a923ae0a-4aa7-431c-ae15-24011a930d8e'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:07 devstack cinder-volume[82595]: WARNING cinder.quota [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-581829746 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-581829746, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:34:07 devstack cinder-volume[82595]: WARNING cinder.quota [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-581829746 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-581829746, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:34:07 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Created reservations ['c2ce9409-647d-473f-9108-ce0bf89af340', '74bf7a1b-a852-4c89-9d21-99298a6a4c5d', '33216924-8f07-47f7-bd6c-e4aa281d6702', '7bec318a-41be-4ce6-b83a-abe79bd2ea5d'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:07 devstack sudo[85174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:07 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:08 devstack sudo[85146]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-662d25ed-086a-4551-84a2-33fb3582e7f8" returned: 0 in 1.175s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Lock "cinder-quobyte-662d25ed-086a-4551-84a2-33fb3582e7f8" released by "delete_volume" :: held 2.283s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:08 devstack cinder-volume[82595]: DEBUG cinder.quota [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Created reservations ['74044b32-98ec-41ad-9116-b2d16578dcc6', '06fc81ab-a337-4271-acd7-b2de05327a88', '3202ade7-ff55-416d-8e28-c97650b8bac2', '8cfb6787-a784-436f-9e68-9bb74afb0518'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:08 devstack sudo[85183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:08 devstack sudo[85183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:09 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 1.452s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:09 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:09 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a1a897cf-62aa-4a7d-afdf-cd2972fe153b tempest-GroupsV314Test-521774702 None] Delete group completed successfully. Apr 15 13:34:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Acquiring lock "cinder-quobyte-252e8fab-6499-49b5-b209-80d1e216a6ce" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Lock "cinder-quobyte-252e8fab-6499-49b5-b209-80d1e216a6ce" acquired by "delete_volume" :: waited 0.020s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:09 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8f5fad-e2a4-4e68-be92-6c2c58197bf6]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:09 devstack sudo[85187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce Apr 15 13:34:09 devstack sudo[85187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:09 devstack sudo[85183]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 1.626s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:09 devstack cinder-volume[82595]: DEBUG cinder.manager [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:09 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Deleted volume successfully. Apr 15 13:34:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-595dbd8d-e6f2-4c0d-a803-a9003a176dee req-c88ce44f-3621-490d-ac1d-4eea05869dc6 tempest-VolumesGetTestJSON-1357433742 None] Lock "cinder-662d25ed-086a-4551-84a2-33fb3582e7f8-delete_volume" released by "delete_volume" :: held 4.291s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:10 devstack sudo[85187]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce" returned: 0 in 1.139s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:10 devstack sudo[85194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce Apr 15 13:34:10 devstack sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:10 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Flow 'volume_create_manager' (937e25c5-bce2-4c87-9481-be174d2cd63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b69b612-0eda-45c5-828e-27bd99691631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b69b612-0eda-45c5-828e-27bd99691631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:10Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc128f55-e2b8-4e39-ae40-771f15bcf4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69fbaccf20f49fea971b9a730661016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:11Z,use_quota=True,user_id='ee58ebb42d47475c8a62d8754facd5a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36eaa2af-b0f3-4eca-92a4-80b605342bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36eaa2af-b0f3-4eca-92a4-80b605342bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9a419e-5113-4f3e-a651-1a7cc41d0d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:11 devstack cinder-volume[82595]: DEBUG cinder.image.glance [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Creating Keystone auth plugin from conf {{(pid=82595) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 13:34:11 devstack sudo[85194]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-252e8fab-6499-49b5-b209-80d1e216a6ce" returned: 0 in 1.059s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Lock "cinder-quobyte-252e8fab-6499-49b5-b209-80d1e216a6ce" released by "delete_volume" :: held 2.310s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:11 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Created reservations ['3721ba28-dbf5-4e85-af53-e0ac273cafe6'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:11 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Created reservations ['290bac7c-cd85-49a9-a3a3-21c74eeda5f1', 'c513b003-2afa-4f08-bdf0-161bf32f384d', '4014e7a9-9b5f-4cf3-896c-f8b11272a3e0', 'dd41e18a-5e77-4293-9cb6-503b64528dc4'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9a419e-5113-4f3e-a651-1a7cc41d0d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc128f55-e2b8-4e39-ae40-771f15bcf4da', 'volume_name': 'volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8962bff-b962-41b4-83c2-92bb009f43f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8962bff-b962-41b4-83c2-92bb009f43f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:12 devstack sudo[85243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:12 devstack sudo[85243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954d12ed-2b4d-480e-810a-4193444ca0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:12 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Volume bc128f55-e2b8-4e39-ae40-771f15bcf4da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Trying to clone bc128f55-e2b8-4e39-ae40-771f15bcf4da from image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]). {{(pid=82595) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 13:34:12 devstack cinder-volume[82595]: INFO cinder.image.image_utils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Image download 20.69 MB at 20.69 MB/s Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[39055585-24ec-44ee-994d-688f1c6e04d1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:12 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD Apr 15 13:34:12 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:13 devstack sudo[85243]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 1.101s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:13 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:13 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b56398a8-3b4d-4559-afbf-da082b6a15bd tempest-GroupsV314Test-521774702 None] Delete group completed successfully. Apr 15 13:34:13 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD" returned: 0 in 1.217s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:13 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Temporary image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 is fetched for user ee58ebb42d47475c8a62d8754facd5a6. {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 13:34:13 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e46f2-30cd-4f8c-89f5-7bd9f34a4d73]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:13 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD Apr 15 13:34:13 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:15 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD" returned: 0 in 1.370s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:10Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc128f55-e2b8-4e39-ae40-771f15bcf4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69fbaccf20f49fea971b9a730661016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:11Z,use_quota=True,user_id='ee58ebb42d47475c8a62d8754facd5a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Creating volume bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:15 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:15 devstack sudo[85291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da 1073741824 Apr 15 13:34:15 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:15 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-8613d09e-3143-487d-87b3-c3dd91f12cb5 tempest-GroupsTest-579171645 None] Group tempest-Group1-720966947: creating Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Flow 'volume_create_manager' (63864000-c69e-4be8-9f28-5a98603d0b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477ed420-d4ca-4ebf-8266-46f8eabd207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477ed420-d4ca-4ebf-8266-46f8eabd207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1121520897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c71c8a-7866-4c58-b0f3-2e1bb404db4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ad4f49f9ec403eaae65a52dc6ccb3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:15Z,use_quota=True,user_id='4f44c17dae59447487d8247bb8b21f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecce193a-185d-4277-be9b-429f539b262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecce193a-185d-4277-be9b-429f539b262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e1dcd6-cd53-480a-a9ee-36247824766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e1dcd6-cd53-480a-a9ee-36247824766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c71c8a-7866-4c58-b0f3-2e1bb404db4b', 'volume_name': 'volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc52ae9-e8d1-42d5-a254-6a4325824980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc52ae9-e8d1-42d5-a254-6a4325824980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85231ca1-f890-4249-8ac2-866aef52e503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:15 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Volume b5c71c8a-7866-4c58-b0f3-2e1bb404db4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b', 'volume_size': 1} Apr 15 13:34:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:15 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-8613d09e-3143-487d-87b3-c3dd91f12cb5 tempest-GroupsTest-579171645 None] Group tempest-Group1-720966947: created successfully Apr 15 13:34:15 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-8613d09e-3143-487d-87b3-c3dd91f12cb5 tempest-GroupsTest-579171645 None] Create group completed successfully. Apr 15 13:34:16 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da 1073741824" returned: 0 in 0.976s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:16 devstack sudo[85297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da Apr 15 13:34:16 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:16 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-430efad5-e9ea-48b3-a8b9-ec45c42e2f54 tempest-GroupsTest-579171645 None] Group tempest-Group2-105235971: creating Apr 15 13:34:16 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-430efad5-e9ea-48b3-a8b9-ec45c42e2f54 tempest-GroupsTest-579171645 None] Group tempest-Group2-105235971: created successfully Apr 15 13:34:16 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-430efad5-e9ea-48b3-a8b9-ec45c42e2f54 tempest-GroupsTest-579171645 None] Create group completed successfully. Apr 15 13:34:16 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da" returned: 0 in 0.640s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1121520897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c71c8a-7866-4c58-b0f3-2e1bb404db4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ad4f49f9ec403eaae65a52dc6ccb3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:15Z,use_quota=True,user_id='4f44c17dae59447487d8247bb8b21f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Creating volume b5c71c8a-7866-4c58-b0f3-2e1bb404db4b {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:16 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:16 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b 1073741824 Apr 15 13:34:16 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:17 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Attempting download of 082fb149-5a21-4aac-9c2e-bdc7043feaf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}])) to volume bc128f55-e2b8-4e39-ae40-771f15bcf4da. {{(pid=82595) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 13:34:17 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b764d31-e927-4c74-abe9-c234aed85457]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_fvadd9ef {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:17 devstack sudo[85302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_fvadd9ef Apr 15 13:34:17 devstack sudo[85302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:17 devstack sudo[85302]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_fvadd9ef" returned: 0 in 0.628s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_fvadd9ef {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:17 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_fvadd9ef Apr 15 13:34:17 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:18 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b 1073741824" returned: 0 in 1.175s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:18 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b Apr 15 13:34:18 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Flow 'volume_create_manager' (972523ea-a51a-4878-a33b-864680560611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5242b2b-0534-4595-a757-ef6c8a15d21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5242b2b-0534-4595-a757-ef6c8a15d21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1530971710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f1a367-9dac-4565-aed2-40b7d682e1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd4f0d6fe5a491dbdb2b89bc63b7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:18Z,use_quota=True,user_id='ea547753922c42bb8e78cd6b7c2ca63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c874a1-c7cd-49cc-bd16-64202814b773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c874a1-c7cd-49cc-bd16-64202814b773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcd7294-c0c6-4820-aa87-0718ad60f111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcd7294-c0c6-4820-aa87-0718ad60f111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f1a367-9dac-4565-aed2-40b7d682e1a7', 'volume_name': 'volume-95f1a367-9dac-4565-aed2-40b7d682e1a7', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09eb7c4-64ae-4f7f-acd5-2de48fd43bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09eb7c4-64ae-4f7f-acd5-2de48fd43bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c68a4fe-6940-44c5-acce-8e18aa62556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Volume 95f1a367-9dac-4565-aed2-40b7d682e1a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f1a367-9dac-4565-aed2-40b7d682e1a7', 'volume_size': 1} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Flow 'volume_create_manager' (d7d31c78-884b-4f2b-aea1-eaecb57e4bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60519505-e8d0-4fd0-ba99-8111f52c0ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60519505-e8d0-4fd0-ba99-8111f52c0ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1503386273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73ebbd6a-1d32-4c1d-9f3b-26a1f1b30ee2,host='devstack@QuobyteHD#QuobyteHD',id=e934f40a-193f-4fe2-802c-7fc6c802eac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d973c900a31844cb84fbb33e6db79980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:18Z,use_quota=True,user_id='9e9ffa4a805f47568620bfbc1c05e537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c756f6a-ca7b-441c-be8a-6bc5138dba01),volume_type_id=0c756f6a-ca7b-441c-be8a-6bc5138dba01)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36590245-3ad6-488d-a43b-d5acfad15a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36590245-3ad6-488d-a43b-d5acfad15a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fe7809-1d04-4700-a3e7-b554b81ce4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fe7809-1d04-4700-a3e7-b554b81ce4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e934f40a-193f-4fe2-802c-7fc6c802eac5', 'volume_name': 'volume-e934f40a-193f-4fe2-802c-7fc6c802eac5', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c990c73-7638-4043-926d-aacb68871b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c990c73-7638-4043-926d-aacb68871b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd484e0-d317-4036-8b4f-b9c9dc8fdfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Volume e934f40a-193f-4fe2-802c-7fc6c802eac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e934f40a-193f-4fe2-802c-7fc6c802eac5', 'volume_size': 1} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:18 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_fvadd9ef" returned: 1 in 0.942s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_fvadd9ef' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c804284-edaa-4dc3-a83d-eddab06adbbb]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:18 devstack sudo[85317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD Apr 15 13:34:18 devstack sudo[85317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:18 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b" returned: 0 in 0.590s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1530971710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f1a367-9dac-4565-aed2-40b7d682e1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd4f0d6fe5a491dbdb2b89bc63b7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:18Z,use_quota=True,user_id='ea547753922c42bb8e78cd6b7c2ca63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Creating volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:18 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85231ca1-f890-4249-8ac2-866aef52e503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4239962c-e63d-468d-92a6-baff93b051c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:18 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Volume volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b (b5c71c8a-7866-4c58-b0f3-2e1bb404db4b): created successfully Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4239962c-e63d-468d-92a6-baff93b051c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Flow 'volume_create_manager' (63864000-c69e-4be8-9f28-5a98603d0b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:18 devstack sudo[85320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 1073741824 Apr 15 13:34:18 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:18 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-03c48603-96c3-4a10-9c9c-c6003000b818 tempest-ServersNegativeTestJSON-320015276 None] Created volume successfully. Apr 15 13:34:19 devstack sudo[85317]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD" returned: 0 in 0.602s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:19 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] 082fb149-5a21-4aac-9c2e-bdc7043feaf2 was qcow2, converting to raw {{(pid=82595) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 13:34:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:19 devstack sudo[85327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da Apr 15 13:34:19 devstack sudo[85327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:19 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 1073741824" returned: 0 in 0.912s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:19 devstack sudo[85333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 Apr 15 13:34:19 devstack sudo[85333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:20 devstack sudo[85333]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7" returned: 0 in 0.675s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.788s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73ebbd6a-1d32-4c1d-9f3b-26a1f1b30ee2,created_at=2026-04-15T11:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1503386273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73ebbd6a-1d32-4c1d-9f3b-26a1f1b30ee2,host='devstack@QuobyteHD#QuobyteHD',id=e934f40a-193f-4fe2-802c-7fc6c802eac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d973c900a31844cb84fbb33e6db79980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:18Z,use_quota=True,user_id='9e9ffa4a805f47568620bfbc1c05e537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c756f6a-ca7b-441c-be8a-6bc5138dba01),volume_type_id=0c756f6a-ca7b-441c-be8a-6bc5138dba01)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Creating volume e934f40a-193f-4fe2-802c-7fc6c802eac5 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:20 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:20 devstack sudo[85344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5 1073741824 Apr 15 13:34:20 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c68a4fe-6940-44c5-acce-8e18aa62556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f1a367-9dac-4565-aed2-40b7d682e1a7', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446085e6-7826-4b98-b3a0-9ff8d54dccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:20 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Volume volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 (95f1a367-9dac-4565-aed2-40b7d682e1a7): created successfully Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446085e6-7826-4b98-b3a0-9ff8d54dccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Flow 'volume_create_manager' (972523ea-a51a-4878-a33b-864680560611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:20 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-df96ae1a-14d2-4c4f-9ef4-43f16f99d301 tempest-SnapshotsActionsTest-605110817 None] Created volume successfully. Apr 15 13:34:20 devstack sudo[85327]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da" returned: 0 in 1.365s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_tmyr31l0devstack@QuobyteHD, size 112.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:34:20 devstack cinder-volume[82595]: INFO cinder.image.image_utils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Converted 112.00 MB image at 82.00 MB/s Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:20 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da 1G Apr 15 13:34:20 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Flow 'volume_create_manager' (034011e1-7989-4d7d-8a14-83aae8e4a952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6722f60e-116f-4f69-8aa8-8de1c8ebc5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6722f60e-116f-4f69-8aa8-8de1c8ebc5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1954996122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7add79-1dae-41ad-adc6-7c58d070f7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ad4f49f9ec403eaae65a52dc6ccb3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:21Z,use_quota=True,user_id='4f44c17dae59447487d8247bb8b21f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab563a7-82ce-438f-8d58-39a62a66f2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab563a7-82ce-438f-8d58-39a62a66f2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e928df25-a782-471a-8b40-64705d5dc0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e928df25-a782-471a-8b40-64705d5dc0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7add79-1dae-41ad-adc6-7c58d070f7bb', 'volume_name': 'volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143b679e-0ad1-4b6b-8d08-b8ae14811283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143b679e-0ad1-4b6b-8d08-b8ae14811283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f09c22-1fb8-4638-8855-2a91ebbfaad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Volume 4e7add79-1dae-41ad-adc6-7c58d070f7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb', 'volume_size': 1} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:21 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5 1073741824" returned: 0 in 0.879s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:21 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5 Apr 15 13:34:21 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:21 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da 1G" returned: 0 in 0.726s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f1db51-0a59-4684-ad86-28e98ca3b527]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:21 devstack sudo[85356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da Apr 15 13:34:21 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:21 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5" returned: 0 in 0.638s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.942s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1954996122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7add79-1dae-41ad-adc6-7c58d070f7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ad4f49f9ec403eaae65a52dc6ccb3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:21Z,use_quota=True,user_id='4f44c17dae59447487d8247bb8b21f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Creating volume 4e7add79-1dae-41ad-adc6-7c58d070f7bb {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:21 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:22 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb 1073741824 Apr 15 13:34:22 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd484e0-d317-4036-8b4f-b9c9dc8fdfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e934f40a-193f-4fe2-802c-7fc6c802eac5', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27358e31-70df-4468-b7fe-60c98a89d0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Volume volume-e934f40a-193f-4fe2-802c-7fc6c802eac5 (e934f40a-193f-4fe2-802c-7fc6c802eac5): created successfully Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27358e31-70df-4468-b7fe-60c98a89d0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Flow 'volume_create_manager' (d7d31c78-884b-4f2b-aea1-eaecb57e4bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:22 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-98b9eb42-f0c7-41e9-b377-5fe733138bb0 tempest-GroupsTest-579171645 None] Created volume successfully. Apr 15 13:34:22 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da" returned: 0 in 0.695s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:22 devstack sudo[85363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da Apr 15 13:34:22 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:22 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da" returned: 1 in 0.501s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Downloaded image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}])) to volume bc128f55-e2b8-4e39-ae40-771f15bcf4da successfully. {{(pid=82595) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Temporary image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 for user ee58ebb42d47475c8a62d8754facd5a6 is deleted. {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Marking volume bc128f55-e2b8-4e39-ae40-771f15bcf4da as bootable. {{(pid=82595) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Copying metadata from image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 to bc128f55-e2b8-4e39-ae40-771f15bcf4da. {{(pid=82595) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Creating volume glance metadata for volume bc128f55-e2b8-4e39-ae40-771f15bcf4da backed by image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82595) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954d12ed-2b4d-480e-810a-4193444ca0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0274e4-a780-46d1-9927-3da6fb25746e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Volume volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da (bc128f55-e2b8-4e39-ae40-771f15bcf4da): created successfully Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0274e4-a780-46d1-9927-3da6fb25746e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Flow 'volume_create_manager' (937e25c5-bce2-4c87-9481-be174d2cd63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:22 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-26c829f6-7865-41ad-b9df-1329d7494db1 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Created volume successfully. Apr 15 13:34:22 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb 1073741824" returned: 0 in 0.843s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:22 devstack sudo[85372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb Apr 15 13:34:22 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Acquiring lock "cinder-quobyte-e934f40a-193f-4fe2-802c-7fc6c802eac5" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Lock "cinder-quobyte-e934f40a-193f-4fe2-802c-7fc6c802eac5" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9b0ba3-a478-45df-b513-6f8b5b75e31a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:23 devstack sudo[85374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5 Apr 15 13:34:23 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:23 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb" returned: 0 in 0.529s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.685s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f09c22-1fb8-4638-8855-2a91ebbfaad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a88a76-73b9-4404-9d24-f1c551e75511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Creating offline snapshot 6d462b29-e53e-470d-b2ca-c5259b39cec8 of volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:34:23 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Volume volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb (4e7add79-1dae-41ad-adc6-7c58d070f7bb): created successfully Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a88a76-73b9-4404-9d24-f1c551e75511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Flow 'volume_create_manager' (034011e1-7989-4d7d-8a14-83aae8e4a952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[77575c88-1cfb-4259-9442-981d067238a8]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:23 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-ab1c0799-7894-470e-a245-1a212108bb90 tempest-ServersNegativeTestJSON-320015276 None] Created volume successfully. Apr 15 13:34:23 devstack sudo[85377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 Apr 15 13:34:23 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:23 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5" returned: 0 in 0.572s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:23 devstack sudo[85382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5 Apr 15 13:34:23 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:24 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7" returned: 0 in 0.649s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:24 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 1G Apr 15 13:34:24 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:24 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e934f40a-193f-4fe2-802c-7fc6c802eac5" returned: 0 in 0.509s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Lock "cinder-quobyte-e934f40a-193f-4fe2-802c-7fc6c802eac5" released by "delete_volume" :: held 1.113s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Created reservations ['60a9332d-925f-4e8d-b8d3-1432f00c4bf4'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:24 devstack cinder-volume[82595]: WARNING cinder.quota [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1816036407 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1816036407, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:34:24 devstack cinder-volume[82595]: WARNING cinder.quota [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1816036407 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1816036407, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Created reservations ['90bb31c8-e169-4b47-b796-5d3aa8117850', '63ba44fa-64ef-43ab-acfd-e384c841b9cf', 'b006a72a-e135-4acd-b0c0-e899398da1c5', '94e92993-6f8f-4a37-b4c6-db666751ac15'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Acquiring lock "cinder-4e7add79-1dae-41ad-adc6-7c58d070f7bb-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Lock "cinder-4e7add79-1dae-41ad-adc6-7c58d070f7bb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Acquiring lock "cinder-quobyte-4e7add79-1dae-41ad-adc6-7c58d070f7bb" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Lock "cinder-quobyte-4e7add79-1dae-41ad-adc6-7c58d070f7bb" acquired by "delete_volume" :: waited 0.036s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:24 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:24 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8292757-ea92-4142-95d1-403c13e9738d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:24 devstack sudo[85392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb Apr 15 13:34:24 devstack sudo[85392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:24 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 1G" returned: 0 in 0.608s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:24 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:24 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:25 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.567s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:25 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b2bf578e-e39b-426f-9162-626442a2c820 tempest-GroupsTest-579171645 None] Delete group completed successfully. Apr 15 13:34:25 devstack sudo[85392]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb" returned: 0 in 0.572s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:25 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb Apr 15 13:34:25 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:25 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.554s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:25 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 is being set with open permissions: ugo+rw Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:25 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:25 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:25 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4e7add79-1dae-41ad-adc6-7c58d070f7bb" returned: 0 in 0.441s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Lock "cinder-quobyte-4e7add79-1dae-41ad-adc6-7c58d070f7bb" released by "delete_volume" :: held 1.073s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Created reservations ['6d7dbaff-d30a-454c-81d0-01709636ee11', '812880ef-90de-439a-93c2-fe0a202ba773', 'd8a3045d-0c16-4692-a45c-12e6135b8527', '84b2c73d-38cd-428e-b08b-dc4491562460'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-a9cc117a-49ec-4791-a8c5-7314f07c49a2 tempest-GroupsTest-579171645 None] Created reservations ['b43c101c-803a-46a8-aa3b-ca884de8de4f'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a9cc117a-49ec-4791-a8c5-7314f07c49a2 tempest-GroupsTest-579171645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a9cc117a-49ec-4791-a8c5-7314f07c49a2 tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a9cc117a-49ec-4791-a8c5-7314f07c49a2 tempest-GroupsTest-579171645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a9cc117a-49ec-4791-a8c5-7314f07c49a2 tempest-GroupsTest-579171645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a9cc117a-49ec-4791-a8c5-7314f07c49a2 tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a9cc117a-49ec-4791-a8c5-7314f07c49a2 tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:25 devstack sudo[85412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:25 devstack sudo[85412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:25 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:25 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:25 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.492s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:25 devstack sudo[85416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.info Apr 15 13:34:25 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-00a44dba-1522-4dff-97fa-99c6de539a69 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:26 devstack sudo[85412]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a9cc117a-49ec-4791-a8c5-7314f07c49a2 tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.794s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-a9cc117a-49ec-4791-a8c5-7314f07c49a2 tempest-GroupsTest-579171645 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:26 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a9cc117a-49ec-4791-a8c5-7314f07c49a2 tempest-GroupsTest-579171645 None] Delete group completed successfully. Apr 15 13:34:26 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.801s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:26 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Deleted volume successfully. Apr 15 13:34:26 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.info" returned: 0 in 0.722s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:26 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.info is being set with open permissions: ugo+rw Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1ff75a2a-1039-4702-a30a-881e287404a6 tempest-ServersNegativeTestJSON-320015276 None] Lock "cinder-4e7add79-1dae-41ad-adc6-7c58d070f7bb-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:26 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.info Apr 15 13:34:26 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Acquiring lock "cinder-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Lock "cinder-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Acquiring lock "cinder-quobyte-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Lock "cinder-quobyte-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[206b48a5-3852-44d9-91bb-923590b34192]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:26 devstack sudo[85431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b Apr 15 13:34:26 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:27 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.info" returned: 0 in 0.554s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.669s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-00a44dba-1522-4dff-97fa-99c6de539a69 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.784s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ae918d-956e-4592-88ca-cd838daa86ee]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:27 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-30d28924-3a68-433d-86a4-b828c132469d tempest-GroupsTest-579171645 None] Group tempest-GroupsTest-Group-624458104: creating Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-00a44dba-1522-4dff-97fa-99c6de539a69 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:27 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-06d3018e-d4dc-4381-b69b-b1595641d841 tempest-SnapshotsActionsTest-605110817 None] Create snapshot completed successfully Apr 15 13:34:27 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-30d28924-3a68-433d-86a4-b828c132469d tempest-GroupsTest-579171645 None] Group tempest-GroupsTest-Group-624458104: created successfully Apr 15 13:34:27 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-30d28924-3a68-433d-86a4-b828c132469d tempest-GroupsTest-579171645 None] Create group completed successfully. Apr 15 13:34:27 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b" returned: 0 in 0.526s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:27 devstack sudo[85437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da Apr 15 13:34:27 devstack sudo[85437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:27 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b Apr 15 13:34:27 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:27 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b" returned: 0 in 0.505s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Lock "cinder-quobyte-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b" released by "delete_volume" :: held 1.061s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:27 devstack sudo[85437]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-00a44dba-1522-4dff-97fa-99c6de539a69 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da" returned: 0 in 0.590s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-00a44dba-1522-4dff-97fa-99c6de539a69 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Created reservations ['09984911-b0ab-4723-a31d-3aab95f26893', '7e2e6362-cd7d-4154-8875-09b296d2dd6d', '401a179a-6744-4c29-886a-821e62f246a7', 'e5741629-fac8-4889-8252-485e46f6fece'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:27 devstack sudo[85445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da Apr 15 13:34:27 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:27 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:27 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:28 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.433s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:28 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:28 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Deleted volume successfully. Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-00a44dba-1522-4dff-97fa-99c6de539a69 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da" returned: 1 in 0.517s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-00a44dba-1522-4dff-97fa-99c6de539a69 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-be8d03db-32ce-447c-8967-f27003ff4004 req-00a44dba-1522-4dff-97fa-99c6de539a69 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.143s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.651s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c6e22c87-afdf-41f6-8b38-1c6ac2676fff tempest-ServersNegativeTestJSON-320015276 None] Lock "cinder-b5c71c8a-7866-4c58-b0f3-2e1bb404db4b-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] Creating offline snapshot e379b52c-f31a-443f-b743-ea410a9138f9 of volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[6891b9eb-1a1a-4edf-a4a4-b8e1042a0b87]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-00a44dba-1522-4dff-97fa-99c6de539a69 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e', 'name': 'volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08e89ea6-fb42-49d9-9309-bd0984dbe247', 'enforce_multipath': True} {{(pid=82595) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 13:34:28 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-be8d03db-32ce-447c-8967-f27003ff4004 req-00a44dba-1522-4dff-97fa-99c6de539a69 tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] attachment_update completed successfully. Apr 15 13:34:28 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:28 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Flow 'volume_create_manager' (4d1ddb8e-94e6-405a-8433-7d6fcd07f09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84eab87e-4516-4450-925d-6df15ff1c6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84eab87e-4516-4450-925d-6df15ff1c6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763724608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6816e7d-206b-4dac-9a17-8c2e0b4a6821,host='devstack@QuobyteHD#QuobyteHD',id=9e1760af-0d2c-4125-9670-dfb973e02bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d973c900a31844cb84fbb33e6db79980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:28Z,use_quota=True,user_id='9e9ffa4a805f47568620bfbc1c05e537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c3abe81-0c02-455d-b846-b6a52f0b74f2),volume_type_id=5c3abe81-0c02-455d-b846-b6a52f0b74f2)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bc641b-1915-45b4-86ae-40266b005b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bc641b-1915-45b4-86ae-40266b005b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f68d06-1bd7-4655-9554-5e617b357623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f68d06-1bd7-4655-9554-5e617b357623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1760af-0d2c-4125-9670-dfb973e02bc2', 'volume_name': 'volume-9e1760af-0d2c-4125-9670-dfb973e02bc2', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d28083-bedd-4bf8-96c3-427d52eed719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d28083-bedd-4bf8-96c3-427d52eed719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35376458-cb6b-4d0f-9e83-fab352de6cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:28 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Volume 9e1760af-0d2c-4125-9670-dfb973e02bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1760af-0d2c-4125-9670-dfb973e02bc2', 'volume_size': 1} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:28 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.553s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:28 devstack sudo[85458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 1G Apr 15 13:34:28 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:29 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 1G" returned: 0 in 0.519s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:29 devstack sudo[85464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 Apr 15 13:34:29 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:29 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:29 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 is being set with open permissions: ugo+rw Apr 15 13:34:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:29 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 Apr 15 13:34:29 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:30 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9" returned: 0 in 0.492s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b6816e7d-206b-4dac-9a17-8c2e0b4a6821,created_at=2026-04-15T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763724608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6816e7d-206b-4dac-9a17-8c2e0b4a6821,host='devstack@QuobyteHD#QuobyteHD',id=9e1760af-0d2c-4125-9670-dfb973e02bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d973c900a31844cb84fbb33e6db79980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:28Z,use_quota=True,user_id='9e9ffa4a805f47568620bfbc1c05e537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c3abe81-0c02-455d-b846-b6a52f0b74f2),volume_type_id=5c3abe81-0c02-455d-b846-b6a52f0b74f2)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Creating volume 9e1760af-0d2c-4125-9670-dfb973e02bc2 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:30 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:30 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2 1073741824 Apr 15 13:34:30 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:30 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-975623a5-500b-4091-b2d3-b169646bff58 tempest-SnapshotsActionsTest-605110817 None] Create snapshot completed successfully Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-e379b52c-f31a-443f-b743-ea410a9138f9-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-e379b52c-f31a-443f-b743-ea410a9138f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-quobyte-e379b52c-f31a-443f-b743-ea410a9138f9" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-e379b52c-f31a-443f-b743-ea410a9138f9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Deleting offline snapshot e379b52c-f31a-443f-b743-ea410a9138f9 of volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] snapshot_file for this snap is: volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[45926b59-8540-44d7-90fc-e71e3cca8530]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:30 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2 1073741824" returned: 0 in 0.572s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:30 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 Apr 15 13:34:30 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:30 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2 Apr 15 13:34:30 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:31 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:31 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9" returned: 0 in 0.532s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2" returned: 0 in 0.463s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d43f0a5-ed1f-4525-82de-f400158b89df]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35376458-cb6b-4d0f-9e83-fab352de6cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1760af-0d2c-4125-9670-dfb973e02bc2', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee6d82f-46b7-4f42-87e1-8a45959902fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:31 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Volume volume-9e1760af-0d2c-4125-9670-dfb973e02bc2 (9e1760af-0d2c-4125-9670-dfb973e02bc2): created successfully Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee6d82f-46b7-4f42-87e1-8a45959902fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Flow 'volume_create_manager' (4d1ddb8e-94e6-405a-8433-7d6fcd07f09d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:31 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-19afb0d9-05b0-42ee-ae5a-32a44d0e0c21 tempest-GroupsTest-579171645 None] Created volume successfully. Apr 15 13:34:31 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:31 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:31 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Flow 'volume_create_manager' (03220147-e69b-4591-bc8a-41fad03d1aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2174ebad-85ad-4df8-8ed3-6a787a9d63eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2174ebad-85ad-4df8-8ed3-6a787a9d63eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-483642601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6816e7d-206b-4dac-9a17-8c2e0b4a6821,host='devstack@QuobyteHD#QuobyteHD',id=6ff6b1af-4d38-46c3-af47-876c07601dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d973c900a31844cb84fbb33e6db79980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:32Z,use_quota=True,user_id='9e9ffa4a805f47568620bfbc1c05e537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c3abe81-0c02-455d-b846-b6a52f0b74f2),volume_type_id=5c3abe81-0c02-455d-b846-b6a52f0b74f2)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae49645f-04e4-46d5-a1ad-82a1569eedc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae49645f-04e4-46d5-a1ad-82a1569eedc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01aa8e91-c17a-47e7-93ed-f4c9120313ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01aa8e91-c17a-47e7-93ed-f4c9120313ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff6b1af-4d38-46c3-af47-876c07601dbb', 'volume_name': 'volume-6ff6b1af-4d38-46c3-af47-876c07601dbb', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f84feac-80c3-4925-b952-550740bac77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f84feac-80c3-4925-b952-550740bac77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:32 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a69532-f1c3-4bd1-8308-1d7027398326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:32 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Volume 6ff6b1af-4d38-46c3-af47-876c07601dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff6b1af-4d38-46c3-af47-876c07601dbb', 'volume_size': 1} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b6816e7d-206b-4dac-9a17-8c2e0b4a6821,created_at=2026-04-15T11:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-483642601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6816e7d-206b-4dac-9a17-8c2e0b4a6821,host='devstack@QuobyteHD#QuobyteHD',id=6ff6b1af-4d38-46c3-af47-876c07601dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d973c900a31844cb84fbb33e6db79980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:32Z,use_quota=True,user_id='9e9ffa4a805f47568620bfbc1c05e537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c3abe81-0c02-455d-b846-b6a52f0b74f2),volume_type_id=5c3abe81-0c02-455d-b846-b6a52f0b74f2)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Creating volume 6ff6b1af-4d38-46c3-af47-876c07601dbb {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:32 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.627s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:32 devstack sudo[85604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb 1073741824 Apr 15 13:34:32 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:32 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 Apr 15 13:34:32 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:32 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb 1073741824" returned: 0 in 0.515s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:32 devstack sudo[85615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb Apr 15 13:34:32 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:32 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9" returned: 0 in 0.551s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:32 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9 Apr 15 13:34:32 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:33 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb" returned: 0 in 0.460s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a69532-f1c3-4bd1-8308-1d7027398326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff6b1af-4d38-46c3-af47-876c07601dbb', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54f43ec-33dd-4739-851c-a1ac47d11928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:33 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Volume volume-6ff6b1af-4d38-46c3-af47-876c07601dbb (6ff6b1af-4d38-46c3-af47-876c07601dbb): created successfully Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54f43ec-33dd-4739-851c-a1ac47d11928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Flow 'volume_create_manager' (03220147-e69b-4591-bc8a-41fad03d1aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:33 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b45c1079-40a1-440b-9a75-f64419a95840 tempest-GroupsTest-579171645 None] Created volume successfully. Apr 15 13:34:33 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.e379b52c-f31a-443f-b743-ea410a9138f9" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-e379b52c-f31a-443f-b743-ea410a9138f9" released by "_delete_snapshot" :: held 2.292s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" released by "delete_snapshot" :: held 2.306s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:33 devstack cinder-volume[82595]: WARNING cinder.quota [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Created reservations ['46124b84-3e03-4a80-8c86-1ea2046f4344', '7a4ae30e-0616-43f1-8d1e-0207daa103de', 'eb9cbe2b-3581-4b59-a889-5d808ad9c196', '8cf3a2df-2d9d-4105-b169-bb28907f3200'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:33 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Delete snapshot completed successfully. Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-efba8d4c-f32c-4f42-9e93-1342e0fb9ece tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-e379b52c-f31a-443f-b743-ea410a9138f9-delete_snapshot" released by "delete_snapshot" :: held 2.428s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG oslo_service.periodic_task [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82595) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:33 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:33 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:34 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.792s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:34 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:34 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-7303b889-a596-4245-b7d2-443a3909a8a7 tempest-GroupsTest-579171645 None] Update group completed successfully. Apr 15 13:34:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] Creating offline snapshot f35d4882-e830-4e95-8379-0825a957e6b2 of volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:34:34 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9532bddd-aa63-40db-9a4d-516de1fba79b]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:34 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:34 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:35 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.584s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:35 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 1G Apr 15 13:34:35 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:35 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-512c3f39-d06c-4042-8a09-cff5ecc75220 tempest-GroupsTest-579171645 None] Update group completed successfully. Apr 15 13:34:35 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 1G" returned: 0 in 0.670s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:35 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 Apr 15 13:34:35 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:36 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2" returned: 0 in 0.632s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:36 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 is being set with open permissions: ugo+rw Apr 15 13:34:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:36 devstack sudo[85991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 Apr 15 13:34:36 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:36 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2" returned: 0 in 0.537s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:37 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-15ac820e-9132-4bf2-bcfc-c2677c7f575a tempest-SnapshotsActionsTest-605110817 None] Create snapshot completed successfully Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Acquiring lock "cinder-quobyte-6ff6b1af-4d38-46c3-af47-876c07601dbb" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Lock "cinder-quobyte-6ff6b1af-4d38-46c3-af47-876c07601dbb" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6b44b2-dc55-4b52-92e6-fb3f88637a64]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:37 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb Apr 15 13:34:37 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:37 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb" returned: 0 in 0.632s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:37 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb Apr 15 13:34:37 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-f35d4882-e830-4e95-8379-0825a957e6b2-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-f35d4882-e830-4e95-8379-0825a957e6b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-quobyte-f35d4882-e830-4e95-8379-0825a957e6b2" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-f35d4882-e830-4e95-8379-0825a957e6b2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Deleting offline snapshot f35d4882-e830-4e95-8379-0825a957e6b2 of volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] snapshot_file for this snap is: volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f4e85-1bc3-438f-a0af-d0231157f9a2]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:38 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 Apr 15 13:34:38 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:38 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6ff6b1af-4d38-46c3-af47-876c07601dbb" returned: 0 in 0.821s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Lock "cinder-quobyte-6ff6b1af-4d38-46c3-af47-876c07601dbb" released by "delete_volume" :: held 1.483s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Acquiring lock "cinder-quobyte-9e1760af-0d2c-4125-9670-dfb973e02bc2" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Lock "cinder-quobyte-9e1760af-0d2c-4125-9670-dfb973e02bc2" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:38 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[d154f28c-12ee-41a9-ba5d-f6070a3f7446]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:38 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2" returned: 0 in 0.790s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:38 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ec4ded-20af-4247-b13f-1ec00da0bb14]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:38 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2 Apr 15 13:34:38 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:38 devstack sudo[86029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:38 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:39 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2" returned: 0 in 0.733s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:39 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2 Apr 15 13:34:39 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:39 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.868s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:39 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 Apr 15 13:34:39 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:39 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e1760af-0d2c-4125-9670-dfb973e02bc2" returned: 0 in 0.680s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Lock "cinder-quobyte-9e1760af-0d2c-4125-9670-dfb973e02bc2" released by "delete_volume" :: held 1.452s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Created reservations ['eb0d98d9-c30d-4e8e-85c0-81b80124f290'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:40 devstack cinder-volume[82595]: WARNING cinder.quota [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-676067320 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-676067320, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:34:40 devstack cinder-volume[82595]: WARNING cinder.quota [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-676067320 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-676067320, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Created reservations ['a3a6a56a-62df-4cd9-8cff-bfe929ad21eb', 'd5a86019-6c80-4e8a-9ade-cd80c7d68692', '8605596e-8fad-4ea9-b04c-9ac583296b43', 'fa1d8a0b-c6fb-4193-97e6-920f6e50619a'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:40 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2" returned: 0 in 0.654s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Created reservations ['60a7a369-231a-44b4-9027-286340596419', '58d88a64-1cbf-4340-b9f8-d98facf38cec', '61b08f3e-7799-4f80-8191-3d7fbc0f5084', 'e788f043-c53a-4d19-b9c4-5879ed1c90f1'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:40 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2 Apr 15 13:34:40 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:40 devstack sudo[86065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:40 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:40 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.f35d4882-e830-4e95-8379-0825a957e6b2" returned: 0 in 0.571s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-f35d4882-e830-4e95-8379-0825a957e6b2" released by "_delete_snapshot" :: held 2.940s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" released by "delete_snapshot" :: held 2.955s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Created reservations ['fa20cafc-f5e6-4315-9532-bf8423a4823e', 'cdea90cf-dfe2-478b-b9bd-fa16c0ec14d5', '3158ab93-8bb8-47df-b80c-401d132abc3a', '48560ebb-c829-44d4-a03a-a1f4bafa142b'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:40 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Delete snapshot completed successfully. Apr 15 13:34:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-bd7bd571-3a54-40e9-904b-f5e9666a27fc tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-f35d4882-e830-4e95-8379-0825a957e6b2-delete_snapshot" released by "delete_snapshot" :: held 3.120s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:41 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.867s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:41 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:41 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6547ad6f-6def-4187-be28-01c06d05940b tempest-GroupsTest-579171645 None] Delete group completed successfully. Apr 15 13:34:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:41 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] Creating offline snapshot b1485189-01af-4163-b3db-c3b32a6a01f7 of volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:34:41 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3d3eb6-9c45-4f17-9ca4-08851074bb58]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:41 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:41 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:41 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.618s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:41 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:41 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 1G Apr 15 13:34:41 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Flow 'volume_create_manager' (833e4910-3ed3-4263-9508-9ad21c13ecee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4aa414c-9e6e-49b4-a6b2-317c1b8889f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4aa414c-9e6e-49b4-a6b2-317c1b8889f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-842234399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f3e432-8c6f-47fa-80a0-0ae90fc8113e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d734c6d6de64384aa016897236076e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:42Z,use_quota=True,user_id='a7589cc7ac1c446eabd4014ea1b81dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5dde046-cc39-4874-a1b2-6d32689f183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5dde046-cc39-4874-a1b2-6d32689f183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b2ef39-5ae5-4398-9aa0-ea002a0c0eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b2ef39-5ae5-4398-9aa0-ea002a0c0eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f3e432-8c6f-47fa-80a0-0ae90fc8113e', 'volume_name': 'volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9bbbac-32d5-42b5-9271-f27f10c4b60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9bbbac-32d5-42b5-9271-f27f10c4b60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6a6e5b-d049-4352-8faa-ce7cfeaf80a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:42 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Volume e7f3e432-8c6f-47fa-80a0-0ae90fc8113e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e', 'volume_size': 1} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:42 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 1G" returned: 0 in 0.756s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:42 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 Apr 15 13:34:42 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:43 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7" returned: 0 in 0.498s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:43 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 is being set with open permissions: ugo+rw Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:43 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 Apr 15 13:34:43 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:43 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7" returned: 0 in 0.447s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.382s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.059s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-842234399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f3e432-8c6f-47fa-80a0-0ae90fc8113e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d734c6d6de64384aa016897236076e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:42Z,use_quota=True,user_id='a7589cc7ac1c446eabd4014ea1b81dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Creating volume e7f3e432-8c6f-47fa-80a0-0ae90fc8113e {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:43 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:43 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9f1299ee-8bfb-48d5-a4d0-3abf4d26eb3a tempest-SnapshotsActionsTest-605110817 None] Create snapshot completed successfully Apr 15 13:34:43 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e 1073741824 Apr 15 13:34:43 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:44 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e 1073741824" returned: 0 in 0.549s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:44 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e Apr 15 13:34:44 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-b1485189-01af-4163-b3db-c3b32a6a01f7-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-b1485189-01af-4163-b3db-c3b32a6a01f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-quobyte-b1485189-01af-4163-b3db-c3b32a6a01f7" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-b1485189-01af-4163-b3db-c3b32a6a01f7" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Deleting offline snapshot b1485189-01af-4163-b3db-c3b32a6a01f7 of volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] snapshot_file for this snap is: volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[375b9067-9982-4d65-9f2e-469486057df3]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:44 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 Apr 15 13:34:44 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:44 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e" returned: 0 in 0.490s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6a6e5b-d049-4352-8faa-ce7cfeaf80a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a815c1-0e03-4793-a998-14a6e11aa723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:44 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Volume volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e (e7f3e432-8c6f-47fa-80a0-0ae90fc8113e): created successfully Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a815c1-0e03-4793-a998-14a6e11aa723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Flow 'volume_create_manager' (833e4910-3ed3-4263-9508-9ad21c13ecee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:44 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-8026fadc-b1a1-45f6-b9f9-c15f1453f152 tempest-VolumesTestJSON-1937802909 None] Created volume successfully. Apr 15 13:34:45 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7" returned: 0 in 0.584s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:45 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[8702772d-0354-4cc9-9dd0-c7d636412093]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:45 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:45 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:45 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.568s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:45 devstack sudo[86188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 Apr 15 13:34:45 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Flow 'volume_create_manager' (125a5ef8-7906-4ad2-b79b-363f60b43786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19dafba7-3817-420f-9cb9-d16a1348c96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19dafba7-3817-420f-9cb9-d16a1348c96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1358059918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b0a6e5-ba68-42ad-aef3-07bdb930ec08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d734c6d6de64384aa016897236076e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:46Z,use_quota=True,user_id='a7589cc7ac1c446eabd4014ea1b81dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1203e18-1ddb-4f09-ad2f-6cdf2bfd1669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1203e18-1ddb-4f09-ad2f-6cdf2bfd1669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5f56a6-baf6-48c7-8498-7e5989e82553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5f56a6-baf6-48c7-8498-7e5989e82553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b0a6e5-ba68-42ad-aef3-07bdb930ec08', 'volume_name': 'volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6099cae-c63c-468d-afec-f8c76e11ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6099cae-c63c-468d-afec-f8c76e11ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48ce8eb-cbda-4c82-a01d-4693f998d4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:46 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Volume 84b0a6e5-ba68-42ad-aef3-07bdb930ec08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08', 'volume_size': 1} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1358059918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b0a6e5-ba68-42ad-aef3-07bdb930ec08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d734c6d6de64384aa016897236076e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:46Z,use_quota=True,user_id='a7589cc7ac1c446eabd4014ea1b81dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Creating volume 84b0a6e5-ba68-42ad-aef3-07bdb930ec08 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:46 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:46 devstack sudo[86190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08 1073741824 Apr 15 13:34:46 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:46 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7" returned: 0 in 0.628s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:46 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7 Apr 15 13:34:46 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:46 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08 1073741824" returned: 0 in 0.642s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:46 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08 Apr 15 13:34:46 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:46 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.b1485189-01af-4163-b3db-c3b32a6a01f7" returned: 0 in 0.644s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-b1485189-01af-4163-b3db-c3b32a6a01f7" released by "_delete_snapshot" :: held 2.525s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" released by "delete_snapshot" :: held 2.541s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Created reservations ['52b66c68-c3c4-449d-8cfd-c60ad639157f', 'e2742ba9-b8ec-4c30-8fcc-aab042247afd', '8e8e8f59-c4e7-469e-a267-39a50d22b455', '7a4982f3-18e2-4dc6-beed-9eafe731f7f7'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:47 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Delete snapshot completed successfully. Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-85403401-06cd-4d12-95eb-ecd0e23b1dcf tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-b1485189-01af-4163-b3db-c3b32a6a01f7-delete_snapshot" released by "delete_snapshot" :: held 2.822s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:47 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08" returned: 0 in 0.673s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48ce8eb-cbda-4c82-a01d-4693f998d4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d7858c-22bf-4aad-8aa1-fa67dc35222b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:47 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Volume volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08 (84b0a6e5-ba68-42ad-aef3-07bdb930ec08): created successfully Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d7858c-22bf-4aad-8aa1-fa67dc35222b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Flow 'volume_create_manager' (125a5ef8-7906-4ad2-b79b-363f60b43786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:47 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-32b964e1-d143-446a-a917-ee87fb63ae84 tempest-VolumesTestJSON-1937802909 None] Created volume successfully. Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] Creating offline snapshot 25c2e1bf-1f70-419f-b886-3eaaa52d3041 of volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ff120-b690-4c5e-a527-9855436263a6]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:48 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:48 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:48 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Flow 'volume_create_manager' (b928363c-ccd3-4ded-be09-10a212c74273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75610b69-2cdb-4847-b0a2-df6d62bb82ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75610b69-2cdb-4847-b0a2-df6d62bb82ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-831177122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ccb2735-f3f6-4443-accf-2802324d8896,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d734c6d6de64384aa016897236076e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:49Z,use_quota=True,user_id='a7589cc7ac1c446eabd4014ea1b81dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931b0cbb-644c-419c-b4ea-e8c1c1ad8594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931b0cbb-644c-419c-b4ea-e8c1c1ad8594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57716947-e81f-43c4-997c-99a9a4dcf68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57716947-e81f-43c4-997c-99a9a4dcf68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ccb2735-f3f6-4443-accf-2802324d8896', 'volume_name': 'volume-1ccb2735-f3f6-4443-accf-2802324d8896', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4277b4-270c-445a-94ef-65060c2570ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4277b4-270c-445a-94ef-65060c2570ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e258a1-157c-4310-a0c8-792ab5d870c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:48 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Volume 1ccb2735-f3f6-4443-accf-2802324d8896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ccb2735-f3f6-4443-accf-2802324d8896', 'volume_size': 1} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.835s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:48 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 1G Apr 15 13:34:48 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:49 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 1G" returned: 0 in 0.625s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:49 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 Apr 15 13:34:49 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:49 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041" returned: 0 in 0.435s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:49 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 is being set with open permissions: ugo+rw Apr 15 13:34:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:49 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 Apr 15 13:34:49 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:50 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041" returned: 0 in 0.492s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.453s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-831177122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ccb2735-f3f6-4443-accf-2802324d8896,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d734c6d6de64384aa016897236076e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:49Z,use_quota=True,user_id='a7589cc7ac1c446eabd4014ea1b81dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Creating volume 1ccb2735-f3f6-4443-accf-2802324d8896 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:50 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:50 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896 1073741824 Apr 15 13:34:50 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-09a809c5-febe-4a5e-8a93-0ae0a403ee0e tempest-SnapshotsActionsTest-605110817 None] Create snapshot completed successfully Apr 15 13:34:50 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:51 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896 1073741824" returned: 0 in 0.656s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:51 devstack sudo[86290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896 Apr 15 13:34:51 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-25c2e1bf-1f70-419f-b886-3eaaa52d3041-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-25c2e1bf-1f70-419f-b886-3eaaa52d3041-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Acquiring lock "cinder-quobyte-25c2e1bf-1f70-419f-b886-3eaaa52d3041" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-25c2e1bf-1f70-419f-b886-3eaaa52d3041" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Deleting offline snapshot 25c2e1bf-1f70-419f-b886-3eaaa52d3041 of volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] snapshot_file for this snap is: volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7474882-8419-4609-91e5-4acff2ef6990]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:51 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 Apr 15 13:34:51 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:51 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896" returned: 0 in 0.686s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e258a1-157c-4310-a0c8-792ab5d870c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ccb2735-f3f6-4443-accf-2802324d8896', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665ff69f-c1fc-4fb7-a0ad-b5d932ae972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:51 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Volume volume-1ccb2735-f3f6-4443-accf-2802324d8896 (1ccb2735-f3f6-4443-accf-2802324d8896): created successfully Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665ff69f-c1fc-4fb7-a0ad-b5d932ae972f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Flow 'volume_create_manager' (b928363c-ccd3-4ded-be09-10a212c74273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:51 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-081c1914-7239-4c61-a29f-33ca9c2c9619 tempest-VolumesTestJSON-1937802909 None] Created volume successfully. Apr 15 13:34:51 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041" returned: 0 in 0.673s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a7ce2b-e88b-4bd9-b8cf-68de56bfb100]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:52 devstack sudo[86331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:52 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:52 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.832s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:52 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 Apr 15 13:34:52 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "cinder-1ccb2735-f3f6-4443-accf-2802324d8896-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-1ccb2735-f3f6-4443-accf-2802324d8896-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "cinder-quobyte-1ccb2735-f3f6-4443-accf-2802324d8896" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-quobyte-1ccb2735-f3f6-4443-accf-2802324d8896" acquired by "delete_volume" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:53 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[888a5f3d-533e-4cfe-abce-163c1b77086c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:53 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896 Apr 15 13:34:53 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:53 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041" returned: 0 in 0.949s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:53 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041 Apr 15 13:34:53 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:54 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896" returned: 0 in 0.813s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:54 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896 Apr 15 13:34:54 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:54 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.25c2e1bf-1f70-419f-b886-3eaaa52d3041" returned: 0 in 0.630s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-25c2e1bf-1f70-419f-b886-3eaaa52d3041" released by "_delete_snapshot" :: held 3.200s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" released by "delete_snapshot" :: held 3.222s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:54 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Created reservations ['6ce5bd44-9e8f-4b3f-b134-7a5649023c44', 'f2418884-0c08-46d0-adf3-65e02da16ef8', '12466548-d556-4e9a-a519-258a4cac0f2e', '5325d6d9-b2d2-4549-b5f2-9b3e10b2d6c6'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:54 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Delete snapshot completed successfully. Apr 15 13:34:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2632b3fc-3ff9-496d-91d6-e413fd93d6d4 tempest-SnapshotsActionsTest-1496604457 None] Lock "cinder-25c2e1bf-1f70-419f-b886-3eaaa52d3041-delete_snapshot" released by "delete_snapshot" :: held 3.465s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:54 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1ccb2735-f3f6-4443-accf-2802324d8896" returned: 0 in 0.691s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-quobyte-1ccb2735-f3f6-4443-accf-2802324d8896" released by "delete_volume" :: held 1.541s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:54 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Created reservations ['a9e640a9-3b76-483e-850c-8d91088bf914', '90a903e4-a278-41a0-b829-18e8e79beb47', 'f5b84ccf-b470-4962-a7c3-4eb0a2247aa5', 'b68cb70e-d3c5-4575-99ef-4f2bd54229b3'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:55 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:55 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:55 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.450s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:55 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Deleted volume successfully. Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00dc9580-d0c7-42f4-a598-2418f8277ad9 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-1ccb2735-f3f6-4443-accf-2802324d8896-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "cinder-84b0a6e5-ba68-42ad-aef3-07bdb930ec08-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-84b0a6e5-ba68-42ad-aef3-07bdb930ec08-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "cinder-quobyte-84b0a6e5-ba68-42ad-aef3-07bdb930ec08" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Flow 'volume_create_manager' (d04120b8-d053-4ec4-a9d3-e288ab66af10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10bb7fd-e37a-4d4b-b2f1-74b84a6bf999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10bb7fd-e37a-4d4b-b2f1-74b84a6bf999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-414316385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa9ceaf-6680-49a6-a6bd-0da73ce89eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edb3ecf90845e6a13d4b44a59f3f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:56Z,use_quota=True,user_id='2977bae38461499090a874b57234c3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fdf169-0994-4bcf-a876-8206ae9d688a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fdf169-0994-4bcf-a876-8206ae9d688a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d15132f-a1b5-44d3-af92-cad63b486999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d15132f-a1b5-44d3-af92-cad63b486999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa9ceaf-6680-49a6-a6bd-0da73ce89eea', 'volume_name': 'volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dbee7c-5592-4c59-8177-d283ca483b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dbee7c-5592-4c59-8177-d283ca483b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d808a91d-5ec9-4d14-9f94-ce888d4f935a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:55 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Volume ffa9ceaf-6680-49a6-a6bd-0da73ce89eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea', 'volume_size': 1} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-414316385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa9ceaf-6680-49a6-a6bd-0da73ce89eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edb3ecf90845e6a13d4b44a59f3f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:34:56Z,use_quota=True,user_id='2977bae38461499090a874b57234c3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Creating volume ffa9ceaf-6680-49a6-a6bd-0da73ce89eea {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:34:55 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-quobyte-84b0a6e5-ba68-42ad-aef3-07bdb930ec08" acquired by "delete_volume" :: waited 0.156s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "cinder-6d462b29-e53e-470d-b2ca-c5259b39cec8-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f5c44d-6ae6-40d2-91f3-f0d6ad13fb2d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:55 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea 1073741824 Apr 15 13:34:55 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Lock "cinder-6d462b29-e53e-470d-b2ca-c5259b39cec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "cinder-quobyte-6d462b29-e53e-470d-b2ca-c5259b39cec8" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Lock "cinder-quobyte-6d462b29-e53e-470d-b2ca-c5259b39cec8" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Deleting offline snapshot 6d462b29-e53e-470d-b2ca-c5259b39cec8 of volume 95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] snapshot_file for this snap is: volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c9b291-fc4d-4be6-937d-dad8edefc5d8]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:55 devstack sudo[86419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08 Apr 15 13:34:55 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:56 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:56 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:56 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.577s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:56 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f1a367-9dac-4565-aed2-40b7d682e1a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:34:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08" returned: 0 in 0.641s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:56 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5da581-42c2-49e8-8c3e-2604e1297cf6]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:56 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08 Apr 15 13:34:56 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:56 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea 1073741824" returned: 0 in 0.715s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:56 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea Apr 15 13:34:56 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:56 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 Apr 15 13:34:56 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:56 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-84b0a6e5-ba68-42ad-aef3-07bdb930ec08" returned: 0 in 0.447s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-quobyte-84b0a6e5-ba68-42ad-aef3-07bdb930ec08" released by "delete_volume" :: held 1.122s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Created reservations ['beb4e178-bae4-49a5-902f-fc0baed29090', 'f8c7be93-ae90-47b7-ada9-0678d3966f60', 'd86e42b5-5718-4a90-bc5a-5f20af856655', '65d9608e-5894-4c62-be8c-470297706cf0'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:57 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea" returned: 0 in 0.461s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d808a91d-5ec9-4d14-9f94-ce888d4f935a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17e9c90-089c-442b-ae65-79daa3ab12cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:34:57 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Volume volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea (ffa9ceaf-6680-49a6-a6bd-0da73ce89eea): created successfully Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17e9c90-089c-442b-ae65-79daa3ab12cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Flow 'volume_create_manager' (d04120b8-d053-4ec4-a9d3-e288ab66af10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:34:57 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6033e849-d68e-4398-8aec-ae82c18f62db tempest-VolumeQuotasAdminTestJSON-427255512 None] Created volume successfully. Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:57 devstack sudo[86451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:57 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:57 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7" returned: 0 in 0.617s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:57 devstack sudo[86453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:57 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:57 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.500s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:57 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Deleted volume successfully. Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2a038d0c-c183-42d3-8676-a9266bc6ef94 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-84b0a6e5-ba68-42ad-aef3-07bdb930ec08-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:57 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.498s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:57 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8 Apr 15 13:34:57 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "cinder-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Acquiring lock "cinder-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "cinder-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Acquiring lock "cinder-quobyte-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "cinder-quobyte-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "cinder-quobyte-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea" acquired by "delete_volume" :: waited 0.020s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-quobyte-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e" acquired by "delete_volume" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[264d15c1-6152-4e57-b0e2-bfdf25c568c6]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[031b273b-2faa-4f44-a575-01947ff6dcbe]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:57 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea Apr 15 13:34:57 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:58 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e Apr 15 13:34:58 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:58 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7.6d462b29-e53e-470d-b2ca-c5259b39cec8" returned: 0 in 0.437s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Lock "cinder-quobyte-6d462b29-e53e-470d-b2ca-c5259b39cec8" released by "_delete_snapshot" :: held 2.195s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" released by "delete_snapshot" :: held 2.207s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Created reservations ['3c48c494-2522-43a8-99a1-8aa83754e0f0', '8bf0269e-0fc8-42fb-b277-f78dbcb522a5', 'a1afbe13-6c88-4e1f-aa74-fa6a6b5bfdd7', '9b846b4b-2ec5-42fb-83b9-63383d6d7ad1'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:58 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Delete snapshot completed successfully. Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-19755cb5-bcfe-449d-9ac6-70e1a762e5af tempest-SnapshotsActionsTest-605110817 None] Lock "cinder-6d462b29-e53e-470d-b2ca-c5259b39cec8-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:58 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-17a817c4-4014-46ce-858a-e7aaeefbbdae tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Terminate volume connection completed successfully. Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-17a817c4-4014-46ce-858a-e7aaeefbbdae tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Deleting attachment 08e89ea6-fb42-49d9-9309-bd0984dbe247. {{(pid=82595) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 13:34:58 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e" returned: 0 in 0.504s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:58 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea" returned: 0 in 0.521s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:58 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e Apr 15 13:34:58 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:58 devstack sudo[86478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea Apr 15 13:34:58 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:58 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e" returned: 0 in 0.397s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-quobyte-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e" released by "delete_volume" :: held 0.931s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:58 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea" returned: 0 in 0.425s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "cinder-quobyte-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea" released by "delete_volume" :: held 0.988s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Created reservations ['e4a187b3-4f78-4379-9f8b-f5550ea7bb8d', 'fcc63d17-4370-4e96-9f5d-7c97e3bb49cb', 'e45befa4-cba1-4d95-afd4-abd49b7aa14d', '75f8d606-c470-4533-b1c9-edbaf8cdc904'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Created reservations ['6b79db1c-3615-4016-9ce1-3b9567ef40d8', '39f34324-4f91-498b-a348-c1b849620243', '7bf5f48f-e07a-4095-9de2-63113531d90d', '5ae6ef18-7744-4e27-b172-20535e532d5d'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "cinder-bc128f55-e2b8-4e39-ae40-771f15bcf4da-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:59 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:59 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "cinder-bc128f55-e2b8-4e39-ae40-771f15bcf4da-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:59 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:34:59 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "cinder-95f1a367-9dac-4565-aed2-40b7d682e1a7-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Lock "cinder-95f1a367-9dac-4565-aed2-40b7d682e1a7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "cinder-quobyte-bc128f55-e2b8-4e39-ae40-771f15bcf4da" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "cinder-quobyte-bc128f55-e2b8-4e39-ae40-771f15bcf4da" acquired by "delete_volume" :: waited 0.019s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[02224ab0-5e06-4b00-9386-6d81b332613b]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eed35d-cd52-4741-afa5-50a1d36a145e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:59 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da Apr 15 13:34:59 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:59 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 Apr 15 13:34:59 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:59 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.431s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:59 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Deleted volume successfully. Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2bcf8b61-0313-41b3-9888-58d97b733866 tempest-VolumesTestJSON-1937802909 None] Lock "cinder-e7f3e432-8c6f-47fa-80a0-0ae90fc8113e-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:59 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.530s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:34:59 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Deleted volume successfully. Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba41274f-0369-4ccf-9a06-0f60f443a9da tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "cinder-ffa9ceaf-6680-49a6-a6bd-0da73ce89eea-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:34:59 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7" returned: 0 in 0.536s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:59 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da" returned: 0 in 0.559s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:34:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:34:59 devstack sudo[86498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7 Apr 15 13:34:59 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:34:59 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da Apr 15 13:34:59 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:00 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-95f1a367-9dac-4565-aed2-40b7d682e1a7" returned: 0 in 0.532s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Lock "cinder-quobyte-95f1a367-9dac-4565-aed2-40b7d682e1a7" released by "delete_volume" :: held 1.106s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:00 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da" returned: 1 in 0.540s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:00 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da Apr 15 13:35:00 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Created reservations ['a6141617-434a-4aaa-8920-17ea6a7388bf', '4202335a-2e55-4408-a753-951ae22fd99d', 'f701a84d-2224-4c0b-96a5-b3f3502301df', '291c78b9-d91f-467f-a5c3-dae86efd250b'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Flow 'volume_create_manager' (d9bf4b83-1490-42d4-9e0b-430256eda9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22e7eeb-3e3e-42c1-b458-d0677f009683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22e7eeb-3e3e-42c1-b458-d0677f009683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-374482317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201d68ae-1873-4bfb-849e-df37a9a3b327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edb3ecf90845e6a13d4b44a59f3f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:00Z,use_quota=True,user_id='2977bae38461499090a874b57234c3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e235f5-6141-47f2-8209-d832b8e1efb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e235f5-6141-47f2-8209-d832b8e1efb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d94bb5-2733-4d1a-8b06-efaf31476ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d94bb5-2733-4d1a-8b06-efaf31476ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201d68ae-1873-4bfb-849e-df37a9a3b327', 'volume_name': 'volume-201d68ae-1873-4bfb-849e-df37a9a3b327', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338661c2-db00-45ae-9816-af320746f8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338661c2-db00-45ae-9816-af320746f8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876971c4-e48a-494d-b2d3-b1826bbca81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:00 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Volume 201d68ae-1873-4bfb-849e-df37a9a3b327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201d68ae-1873-4bfb-849e-df37a9a3b327', 'volume_size': 1} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-374482317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201d68ae-1873-4bfb-849e-df37a9a3b327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edb3ecf90845e6a13d4b44a59f3f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:00Z,use_quota=True,user_id='2977bae38461499090a874b57234c3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Creating volume 201d68ae-1873-4bfb-849e-df37a9a3b327 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:00 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:00 devstack sudo[86508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327 1073741824 Apr 15 13:35:00 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:00 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:00 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:00 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bc128f55-e2b8-4e39-ae40-771f15bcf4da" returned: 0 in 0.584s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "cinder-quobyte-bc128f55-e2b8-4e39-ae40-771f15bcf4da" released by "delete_volume" :: held 1.731s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.quota [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Created reservations ['cb97e3ea-b139-4134-b4b6-7f6080893b63', 'cc75e2d3-09dd-4fa8-b6d0-4420ed291a3d', 'ce99413b-1dbe-4214-ae3d-60f2df675b2f', 'bcfbebaf-ad28-409a-a1aa-f2bc03208d36'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:00 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.540s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:01 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327 1073741824" returned: 0 in 0.579s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:01 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Deleted volume successfully. Apr 15 13:35:01 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:01 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-da94e9c3-2a1a-4df1-ac3a-4ad49256d323 tempest-SnapshotsActionsTest-605110817 None] Lock "cinder-95f1a367-9dac-4565-aed2-40b7d682e1a7-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:01 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327 Apr 15 13:35:01 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:01 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327" returned: 0 in 0.473s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876971c4-e48a-494d-b2d3-b1826bbca81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201d68ae-1873-4bfb-849e-df37a9a3b327', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27038830-9d7c-4fc8-ade9-2cd592cd721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:01 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Volume volume-201d68ae-1873-4bfb-849e-df37a9a3b327 (201d68ae-1873-4bfb-849e-df37a9a3b327): created successfully Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27038830-9d7c-4fc8-ade9-2cd592cd721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Flow 'volume_create_manager' (d9bf4b83-1490-42d4-9e0b-430256eda9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:01 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-bf209d75-b9b3-475e-b62d-9d51c19c23de tempest-VolumeQuotasAdminTestJSON-427255512 None] Created volume successfully. Apr 15 13:35:01 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.606s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG cinder.manager [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:01 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Deleted volume successfully. Apr 15 13:35:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-de4ad6a7-6bda-40a6-be02-1905efe4ef31 req-dd473b9a-a447-4168-b1b4-f820bdf1212e tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "cinder-bc128f55-e2b8-4e39-ae40-771f15bcf4da-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:02 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c66bb70a-6b33-4b82-ad72-772aec980feb tempest-GroupSnapshotsV319Test-95140485 None] Group tempest-GroupSnapshotsV319Test-Group-1097947770: creating Apr 15 13:35:02 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:UPDATE=192,cinder:SELECT=180,cinder:INSERT=50,cinder:DELETE=15 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:35:02 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c66bb70a-6b33-4b82-ad72-772aec980feb tempest-GroupSnapshotsV319Test-95140485 None] Group tempest-GroupSnapshotsV319Test-Group-1097947770: created successfully Apr 15 13:35:02 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c66bb70a-6b33-4b82-ad72-772aec980feb tempest-GroupSnapshotsV319Test-95140485 None] Create group completed successfully. Apr 15 13:35:03 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-7974dc27-ae1f-4212-b7b2-b2f976610cf1 tempest-VolumeQuotasAdminTestJSON-27048582 None] Transfer volume completed successfully. Apr 15 13:35:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Acquiring lock "cinder-201d68ae-1873-4bfb-849e-df37a9a3b327-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Lock "cinder-201d68ae-1873-4bfb-849e-df37a9a3b327-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:03 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:UPDATE=223,cinder:SELECT=178,cinder:DELETE=12,cinder:INSERT=58 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:35:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Acquiring lock "cinder-quobyte-201d68ae-1873-4bfb-849e-df37a9a3b327" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Lock "cinder-quobyte-201d68ae-1873-4bfb-849e-df37a9a3b327" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:03 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f39513-c80c-4802-8b97-a1e608c6c19f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:04 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327 Apr 15 13:35:04 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Flow 'volume_create_manager' (0d852669-ffeb-4aba-b8bf-beefa4976a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e81aa5b-fa89-48f7-8d0f-ec5925a4c9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e81aa5b-fa89-48f7-8d0f-ec5925a4c9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-690808126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd02be28-7365-457d-9234-ed39e8613d99,host='devstack@QuobyteHD#QuobyteHD',id=5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc1fc8029994b3eb20c13d75520d8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:04Z,use_quota=True,user_id='9ef5b2052a1a4a429875ffddbb57a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9ab25b2-b4ac-4b8d-9832-78d404d38ed4),volume_type_id=e9ab25b2-b4ac-4b8d-9832-78d404d38ed4)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4eb6f97-58c7-4127-86a7-4d2bb3dcbdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4eb6f97-58c7-4127-86a7-4d2bb3dcbdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687e743c-d040-4970-a33c-2fffe65bc739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687e743c-d040-4970-a33c-2fffe65bc739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33', 'volume_name': 'volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5ea403-456f-438f-8b51-691ef3e294e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5ea403-456f-438f-8b51-691ef3e294e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a71abce-3eaa-4509-b850-d464bc6c20df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:04 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Volume 5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33', 'volume_size': 1} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fd02be28-7365-457d-9234-ed39e8613d99,created_at=2026-04-15T11:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-690808126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd02be28-7365-457d-9234-ed39e8613d99,host='devstack@QuobyteHD#QuobyteHD',id=5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc1fc8029994b3eb20c13d75520d8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:04Z,use_quota=True,user_id='9ef5b2052a1a4a429875ffddbb57a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9ab25b2-b4ac-4b8d-9832-78d404d38ed4),volume_type_id=e9ab25b2-b4ac-4b8d-9832-78d404d38ed4)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Creating volume 5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:04 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:04 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 1073741824 Apr 15 13:35:04 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:04 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327" returned: 0 in 0.632s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:04 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327 Apr 15 13:35:04 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:05 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 1073741824" returned: 0 in 0.687s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Flow 'volume_create_manager' (0c5e3d33-1414-416e-b2f6-101623f38396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:05 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c5de39-5fec-4627-b532-48d403543132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c5de39-5fec-4627-b532-48d403543132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1631619292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fad9bc-bcd0-4532-97c3-62c67c4cb6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a7527f04a746fcbb812dc361b200a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:05Z,use_quota=True,user_id='a1ccaa429c3b47708bbf128f3cd95782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5d208b8-78c2-4f85-9bf7-849eff3bd5ce),volume_type_id=d5d208b8-78c2-4f85-9bf7-849eff3bd5ce)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78014fe1-a1c5-4840-ae91-f100f0bcf1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78014fe1-a1c5-4840-ae91-f100f0bcf1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f30493-9f42-46fc-872b-3cdcdc6b4238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f30493-9f42-46fc-872b-3cdcdc6b4238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46fad9bc-bcd0-4532-97c3-62c67c4cb6ff', 'volume_name': 'volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18d3a3e-f644-40eb-b6b5-c075e6387650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18d3a3e-f644-40eb-b6b5-c075e6387650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bfbd0a-ddce-4174-8a72-578dd3eeee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:05 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Volume 46fad9bc-bcd0-4532-97c3-62c67c4cb6ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff', 'volume_size': 1} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-201d68ae-1873-4bfb-849e-df37a9a3b327" returned: 0 in 0.624s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Lock "cinder-quobyte-201d68ae-1873-4bfb-849e-df37a9a3b327" released by "delete_volume" :: held 1.286s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:05 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 Apr 15 13:35:05 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Created reservations ['cfdd409a-5767-42e7-bac3-86d89ac15e0d', 'a67beb39-4a3d-4380-a2b7-184195a7d293', '754d5fc8-05b7-44bb-8ea9-d1741067bd0f', '8690631c-57f7-4999-85c6-f85c44e2792a'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:05 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:05 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:05 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" returned: 0 in 0.477s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1631619292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fad9bc-bcd0-4532-97c3-62c67c4cb6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a7527f04a746fcbb812dc361b200a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:05Z,use_quota=True,user_id='a1ccaa429c3b47708bbf128f3cd95782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5d208b8-78c2-4f85-9bf7-849eff3bd5ce),volume_type_id=d5d208b8-78c2-4f85-9bf7-849eff3bd5ce)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Creating volume 46fad9bc-bcd0-4532-97c3-62c67c4cb6ff {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:05 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a71abce-3eaa-4509-b850-d464bc6c20df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc9070d-550a-4217-bf03-311d73507b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:05 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff 1073741824 Apr 15 13:35:05 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:05 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Volume volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 (5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33): created successfully Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc9070d-550a-4217-bf03-311d73507b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Flow 'volume_create_manager' (0d852669-ffeb-4aba-b8bf-beefa4976a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:05 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e6bbb9dc-eceb-418f-ac8b-ecb65a348d54 tempest-GroupSnapshotsV319Test-95140485 None] Created volume successfully. Apr 15 13:35:05 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.451s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:05 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Deleted volume successfully. Apr 15 13:35:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-82ac4956-a0f7-44aa-91a3-ed44248e1b2a tempest-VolumeQuotasAdminTestJSON-1323827766 None] Lock "cinder-201d68ae-1873-4bfb-849e-df37a9a3b327-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:06 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff 1073741824" returned: 0 in 0.565s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:06 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff Apr 15 13:35:06 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:06 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] GroupSnapshot 09efd103-0ef9-4af7-a412-ed5b2d6de2a7: creating. Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Group snapshot 09efd103-0ef9-4af7-a412-ed5b2d6de2a7: creating. {{(pid=82595) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:06 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff" returned: 0 in 0.504s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.131s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bfbd0a-ddce-4174-8a72-578dd3eeee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ec0fd3-39cb-4a1b-a826-7e7527e85b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Creating offline snapshot 24f94842-b7df-44a1-93c8-73c8407a0225 of volume 5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:35:06 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Volume volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff (46fad9bc-bcd0-4532-97c3-62c67c4cb6ff): created successfully Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ec0fd3-39cb-4a1b-a826-7e7527e85b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Flow 'volume_create_manager' (0c5e3d33-1414-416e-b2f6-101623f38396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bb6edd-9998-4662-b8f2-2c68a8713d8e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:06 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-906bfcac-af50-4b84-ba8e-2c5c44457402 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Created volume successfully. Apr 15 13:35:06 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 Apr 15 13:35:06 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:07 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" returned: 0 in 0.528s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:07 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 1G Apr 15 13:35:07 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-903b3bfa-da08-4f0f-892c-f0fa5db23384 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-903b3bfa-da08-4f0f-892c-f0fa5db23384 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-903b3bfa-da08-4f0f-892c-f0fa5db23384 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-903b3bfa-da08-4f0f-892c-f0fa5db23384 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-903b3bfa-da08-4f0f-892c-f0fa5db23384 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-903b3bfa-da08-4f0f-892c-f0fa5db23384 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:07 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:07 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:07 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 1G" returned: 0 in 0.528s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:07 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 Apr 15 13:35:07 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:08 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-903b3bfa-da08-4f0f-892c-f0fa5db23384 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.502s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-903b3bfa-da08-4f0f-892c-f0fa5db23384 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:08 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-903b3bfa-da08-4f0f-892c-f0fa5db23384 tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Retype volume completed successfully. Apr 15 13:35:08 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225" returned: 0 in 0.575s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:08 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:08 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 Apr 15 13:35:08 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Acquiring lock "cinder-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "cinder-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Acquiring lock "cinder-quobyte-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "cinder-quobyte-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd51d5a-27c6-4c11-bbfb-2d849dfff99f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:08 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff Apr 15 13:35:08 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:08 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225" returned: 0 in 0.497s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:09 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.info Apr 15 13:35:09 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:09 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff" returned: 0 in 0.533s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:09 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff Apr 15 13:35:09 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:09 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.info" returned: 0 in 0.510s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:09 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:35:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:09 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.info Apr 15 13:35:09 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:09 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff" returned: 0 in 0.478s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "cinder-quobyte-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff" released by "delete_volume" :: held 1.052s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:09 devstack cinder-volume[82595]: WARNING cinder.quota [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:35:09 devstack cinder-volume[82595]: WARNING cinder.quota [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:35:09 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Created reservations ['185aa2b2-e62f-42a8-a4f4-cf5a0669ae9e', '5562b619-696b-4af5-8db7-d5cf0fe189e4', '31fd97b8-ff18-4533-a27c-61b28342b798', 'baeca836-bbd3-43b9-b390-baba349b2aee'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:10 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:10 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:10 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.info" returned: 0 in 0.535s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.254s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:10 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-cd8a41c9-7184-4865-a56a-f2b3a5a446c7 tempest-GroupSnapshotsV319Test-95140485 None] group_snapshot 09efd103-0ef9-4af7-a412-ed5b2d6de2a7: created successfully Apr 15 13:35:10 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.517s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:10 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Deleted volume successfully. Apr 15 13:35:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01f41364-5ca7-4570-a0de-7d38e12c104d tempest-VolumeRetypeWithoutMigrationTest-1213393914 None] Lock "cinder-46fad9bc-bcd0-4532-97c3-62c67c4cb6ff-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:11 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] group_snapshot 09efd103-0ef9-4af7-a412-ed5b2d6de2a7: deleting Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] group_snapshot 09efd103-0ef9-4af7-a412-ed5b2d6de2a7: deleting {{(pid=82595) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Acquiring lock "cinder-quobyte-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Lock "cinder-quobyte-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Acquiring lock "cinder-quobyte-24f94842-b7df-44a1-93c8-73c8407a0225" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Lock "cinder-quobyte-24f94842-b7df-44a1-93c8-73c8407a0225" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Deleting offline snapshot 24f94842-b7df-44a1-93c8-73c8407a0225 of volume 5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] snapshot_file for this snap is: volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[49de5272-1d1e-4a19-be64-c5d8255ec0b0]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:11 devstack sudo[86641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 Apr 15 13:35:11 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Flow 'volume_create_manager' (5a49fe58-9636-4491-bfbf-8303054a7ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e92844-3f00-4b9f-885e-728dbca67291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e92844-3f00-4b9f-885e-728dbca67291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1023003437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701748c2-d1a2-4b72-8927-c214450c5c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fe303568be420aa86823961161e0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:11Z,use_quota=True,user_id='ec55475183b940afba82729e26020009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fcb504-ab79-47eb-9228-c50a81c3b99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fcb504-ab79-47eb-9228-c50a81c3b99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39aaa6ef-ede4-4918-8a35-7054e355305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39aaa6ef-ede4-4918-8a35-7054e355305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701748c2-d1a2-4b72-8927-c214450c5c42', 'volume_name': 'volume-701748c2-d1a2-4b72-8927-c214450c5c42', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7391f9bf-ab4c-4ec5-8fab-e332e5e4c107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7391f9bf-ab4c-4ec5-8fab-e332e5e4c107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce2469b-4e9a-41a7-ae55-4e151892ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:11 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Volume 701748c2-d1a2-4b72-8927-c214450c5c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701748c2-d1a2-4b72-8927-c214450c5c42', 'volume_size': 1} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1023003437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701748c2-d1a2-4b72-8927-c214450c5c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91fe303568be420aa86823961161e0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:11Z,use_quota=True,user_id='ec55475183b940afba82729e26020009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Creating volume 701748c2-d1a2-4b72-8927-c214450c5c42 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:11 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:11 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 1073741824 Apr 15 13:35:11 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:11 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4192fbdf-8f4f-4392-8198-d6773bbec25f tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Terminate volume connection completed successfully. Apr 15 13:35:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4192fbdf-8f4f-4392-8198-d6773bbec25f tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Deleting attachment 8b8dde3c-e8f2-4a48-8746-aa2f31d2c823. {{(pid=82595) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 13:35:12 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225" returned: 0 in 0.698s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e05bae6-8185-4e8b-b88e-8c7c6072d017]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:12 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 Apr 15 13:35:12 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:12 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 1073741824" returned: 0 in 0.646s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:12 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 Apr 15 13:35:12 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "cinder-caa136b2-2d0f-4baf-bb4a-2892615e301e-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "cinder-caa136b2-2d0f-4baf-bb4a-2892615e301e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "cinder-quobyte-caa136b2-2d0f-4baf-bb4a-2892615e301e" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "cinder-quobyte-caa136b2-2d0f-4baf-bb4a-2892615e301e" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfe6165-9e62-456e-91d8-a12c006b96ba]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:12 devstack sudo[86675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e Apr 15 13:35:12 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:12 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" returned: 0 in 0.773s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:12 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42" returned: 0 in 0.594s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:12 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 Apr 15 13:35:12 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce2469b-4e9a-41a7-ae55-4e151892ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701748c2-d1a2-4b72-8927-c214450c5c42', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d89e58c-508e-4ed3-b4e6-b98106f61d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:12 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Volume volume-701748c2-d1a2-4b72-8927-c214450c5c42 (701748c2-d1a2-4b72-8927-c214450c5c42): created successfully Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d89e58c-508e-4ed3-b4e6-b98106f61d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Flow 'volume_create_manager' (5a49fe58-9636-4491-bfbf-8303054a7ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:12 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c24634fa-ced3-4411-aab0-0e990abafbec tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Created volume successfully. Apr 15 13:35:13 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e" returned: 0 in 0.665s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:13 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e Apr 15 13:35:13 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:13 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225" returned: 0 in 0.633s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:13 devstack sudo[86694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225 Apr 15 13:35:13 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:13 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Creating offline snapshot e4154e99-2b93-406e-87c6-37226b49031f of volume 701748c2-d1a2-4b72-8927-c214450c5c42 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-caa136b2-2d0f-4baf-bb4a-2892615e301e" returned: 0 in 0.529s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eefb96b-d307-46f8-9ffa-08526b7b18aa]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "cinder-quobyte-caa136b2-2d0f-4baf-bb4a-2892615e301e" released by "delete_volume" :: held 1.235s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG cinder.quota [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Created reservations ['9cb01ab3-1723-4972-adb0-45aa3991f215', 'aa0a10dd-3d6d-4c1a-a83e-f81a06b89aeb', 'd6efc3b0-75af-4318-917c-bd4e3400153a', '619c6b1d-b86e-40bd-a74c-624df90872c6'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:13 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 Apr 15 13:35:13 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:13 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:13 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:14 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33.24f94842-b7df-44a1-93c8-73c8407a0225" returned: 0 in 0.563s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Lock "cinder-quobyte-24f94842-b7df-44a1-93c8-73c8407a0225" released by "_delete_snapshot" :: held 2.801s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Lock "cinder-quobyte-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" released by "delete_snapshot" :: held 2.817s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:14 devstack cinder-volume[82595]: WARNING cinder.quota [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-13486964 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-13486964, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:35:14 devstack cinder-volume[82595]: WARNING cinder.quota [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-13486964 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-13486964, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] Created reservations ['77f7bde0-e41d-405a-aee9-d2942fbb65b7', 'e710d200-9cd2-49f6-a057-30612a636178', '7a7d3cce-f561-49f7-b833-43bf9b52dc2a', '4461f2de-eef7-4d33-a412-0a30a4de762d'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:14 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-75ac452e-467b-4b6f-ac57-f745d6ec7e56 tempest-GroupSnapshotsV319Test-95140485 None] group_snapshot 09efd103-0ef9-4af7-a412-ed5b2d6de2a7: deleted successfully Apr 15 13:35:14 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.539s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG cinder.manager [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:14 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Deleted volume successfully. Apr 15 13:35:14 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42" returned: 0 in 0.652s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-24364efe-f30d-46f0-8ba1-99ddd71d90f1 req-4acda13b-857b-49f1-b885-653f18d3264b tempest-ServerBootFromVolumeStableRescueTest-1938049364 None] Lock "cinder-caa136b2-2d0f-4baf-bb4a-2892615e301e-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:14 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f 1G Apr 15 13:35:14 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Acquiring lock "cinder-quobyte-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Lock "cinder-quobyte-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[963c65cf-d022-4fac-8943-0b0a9e60b652]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:14 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 Apr 15 13:35:14 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:15 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f 1G" returned: 0 in 0.654s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701748c2-d1a2-4b72-8927-c214450c5c42 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:15 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701748c2-d1a2-4b72-8927-c214450c5c42 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f Apr 15 13:35:15 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:15 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" returned: 0 in 0.571s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:15 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33 Apr 15 13:35:15 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:15 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701748c2-d1a2-4b72-8927-c214450c5c42 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f" returned: 0 in 0.530s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:15 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f is being set with open permissions: ugo+rw Apr 15 13:35:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:15 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f Apr 15 13:35:15 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:15 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:15 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Lock "cinder-quobyte-5a209b0b-b8d0-430a-ac4e-ea86c9cf5c33" released by "delete_volume" :: held 1.099s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:15 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Created reservations ['a8972548-1972-47f6-9d97-5248b4dc7ec5'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:15 devstack cinder-volume[82595]: WARNING cinder.quota [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-13486964 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-13486964, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:35:15 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Created reservations ['611ceccc-15f5-4dce-959b-909bbe1c8bdb', '40fa18d6-861d-47fa-9540-ad3b2725487c', '02f5258b-00b8-42ec-96d6-fed1261f1a4a', '9a44cea3-933e-4fb2-b5fb-82f6f298d25a'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:16 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:16 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:16 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f" returned: 0 in 0.536s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:16 devstack sudo[86729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.info Apr 15 13:35:16 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:16 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.477s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:16 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-78fb4e07-137e-4bb1-924b-7757e963a3a4 tempest-GroupSnapshotsV319Test-95140485 None] Delete group completed successfully. Apr 15 13:35:16 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.info" returned: 0 in 0.576s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:16 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.info is being set with open permissions: ugo+rw Apr 15 13:35:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:16 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.info Apr 15 13:35:16 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:17 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.info" returned: 0 in 0.590s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.624s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:17 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-72b397ab-8133-4457-a0fc-d7b01c5b29b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Create snapshot completed successfully Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Acquiring lock "cinder-e4154e99-2b93-406e-87c6-37226b49031f-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "cinder-e4154e99-2b93-406e-87c6-37226b49031f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Acquiring lock "cinder-quobyte-701748c2-d1a2-4b72-8927-c214450c5c42" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "cinder-quobyte-701748c2-d1a2-4b72-8927-c214450c5c42" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Acquiring lock "cinder-quobyte-e4154e99-2b93-406e-87c6-37226b49031f" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "cinder-quobyte-e4154e99-2b93-406e-87c6-37226b49031f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Deleting offline snapshot e4154e99-2b93-406e-87c6-37226b49031f of volume 701748c2-d1a2-4b72-8927-c214450c5c42 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] snapshot_file for this snap is: volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf18067-1345-4308-9299-a557e54238b0]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:18 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f Apr 15 13:35:18 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:18 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f" returned: 0 in 0.584s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-701748c2-d1a2-4b72-8927-c214450c5c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b54d5b-2f96-4725-b28f-f06c542f4a09]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:19 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 Apr 15 13:35:19 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:19 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42" returned: 0 in 0.644s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:19 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f Apr 15 13:35:19 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:20 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f" returned: 0 in 0.538s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:20 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f Apr 15 13:35:20 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:20 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42.e4154e99-2b93-406e-87c6-37226b49031f" returned: 0 in 0.579s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "cinder-quobyte-e4154e99-2b93-406e-87c6-37226b49031f" released by "_delete_snapshot" :: held 2.445s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "cinder-quobyte-701748c2-d1a2-4b72-8927-c214450c5c42" released by "delete_snapshot" :: held 2.469s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:20 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Created reservations ['9bf5d5f7-fe10-483f-b698-ca37ba68033c', '74cc61a9-8914-4d31-a16e-706be03c1380', '2387af79-7a84-4d2e-aef5-30bf8fbf9305', '4ce75071-6f54-42da-9f53-91349a47c52e'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:20 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Delete snapshot completed successfully. Apr 15 13:35:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ad572d0-a156-4ff3-a9de-ac4a32268c6f tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "cinder-e4154e99-2b93-406e-87c6-37226b49031f-delete_snapshot" released by "delete_snapshot" :: held 2.597s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Acquiring lock "cinder-701748c2-d1a2-4b72-8927-c214450c5c42-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "cinder-701748c2-d1a2-4b72-8927-c214450c5c42-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Acquiring lock "cinder-quobyte-701748c2-d1a2-4b72-8927-c214450c5c42" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "cinder-quobyte-701748c2-d1a2-4b72-8927-c214450c5c42" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:21 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f1e02c-59d3-4322-954d-69748908a3f4]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:21 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 Apr 15 13:35:21 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c3d25fe9-3a8a-48a0-9b1a-d187c41a197d tempest-GroupsV320Test-324748456 None] Group tempest-GroupsV320Test-Group-107202637: creating Apr 15 13:35:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c3d25fe9-3a8a-48a0-9b1a-d187c41a197d tempest-GroupsV320Test-324748456 None] Group tempest-GroupsV320Test-Group-107202637: created successfully Apr 15 13:35:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c3d25fe9-3a8a-48a0-9b1a-d187c41a197d tempest-GroupsV320Test-324748456 None] Create group completed successfully. Apr 15 13:35:22 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42" returned: 0 in 0.698s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:22 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42 Apr 15 13:35:22 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Flow 'volume_create_manager' (530c4f42-c533-409c-aa0d-e768d4629fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d9ef1f-e1fe-4431-909e-6ef88321aa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d9ef1f-e1fe-4431-909e-6ef88321aa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-787439043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c408203622a04f9e88a23710cd29b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:22Z,use_quota=True,user_id='7dd60b49096244c793c0af8b40b82e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692d1888-3cf3-4ba8-a9f3-e442f3add68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692d1888-3cf3-4ba8-a9f3-e442f3add68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec3959e-2f65-439e-907b-9a4be7baad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec3959e-2f65-439e-907b-9a4be7baad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4', 'volume_name': 'volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0848b272-0b86-4da9-aee8-143515e55edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0848b272-0b86-4da9-aee8-143515e55edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ed0b03-19a6-414b-aae6-9bed006b2ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Volume 3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4', 'volume_size': 1} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-787439043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c408203622a04f9e88a23710cd29b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:22Z,use_quota=True,user_id='7dd60b49096244c793c0af8b40b82e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Creating volume 3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:22 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:22 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 1073741824 Apr 15 13:35:22 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:22 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-701748c2-d1a2-4b72-8927-c214450c5c42" returned: 0 in 0.522s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "cinder-quobyte-701748c2-d1a2-4b72-8927-c214450c5c42" released by "delete_volume" :: held 1.312s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:22 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Created reservations ['397f2d07-ada1-42af-a096-d1060c458928', '0dae93d2-8cc0-411f-996c-29cf5d5bb630', '60764c90-0ea6-41f9-835f-46a92c943e04', 'd6452815-0e49-45f9-be53-9b9fe09c64ae'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:23 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:23 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:23 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 1073741824" returned: 0 in 0.686s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:23 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 Apr 15 13:35:23 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-292c0d7f-29e6-41e6-8de9-6baa4c57f2bb tempest-GroupsV320Test-324748456 None] Created reservations ['85bac58c-2771-4e15-9e95-6568e02c92b0'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-292c0d7f-29e6-41e6-8de9-6baa4c57f2bb tempest-GroupsV320Test-324748456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-292c0d7f-29e6-41e6-8de9-6baa4c57f2bb tempest-GroupsV320Test-324748456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-292c0d7f-29e6-41e6-8de9-6baa4c57f2bb tempest-GroupsV320Test-324748456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-292c0d7f-29e6-41e6-8de9-6baa4c57f2bb tempest-GroupsV320Test-324748456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-292c0d7f-29e6-41e6-8de9-6baa4c57f2bb tempest-GroupsV320Test-324748456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-292c0d7f-29e6-41e6-8de9-6baa4c57f2bb tempest-GroupsV320Test-324748456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:23 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:23 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:23 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.633s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:23 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Deleted volume successfully. Apr 15 13:35:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6eabf38e-676b-4d87-8dbf-daf4906182b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-262074974 None] Lock "cinder-701748c2-d1a2-4b72-8927-c214450c5c42-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:24 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" returned: 0 in 0.712s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ed0b03-19a6-414b-aae6-9bed006b2ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0550ce1a-9e6f-4d34-8c9a-29f489667294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:24 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Volume volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 (3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4): created successfully Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0550ce1a-9e6f-4d34-8c9a-29f489667294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Flow 'volume_create_manager' (530c4f42-c533-409c-aa0d-e768d4629fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:24 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-db6d7955-7ad7-4be2-a821-7e5dc5cea900 req-ccf5724e-4728-4619-bd16-daf7b2e0e255 tempest-VolumesSnapshotsTestJSON-45959941 None] Created volume successfully. Apr 15 13:35:24 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-292c0d7f-29e6-41e6-8de9-6baa4c57f2bb tempest-GroupsV320Test-324748456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.584s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-292c0d7f-29e6-41e6-8de9-6baa4c57f2bb tempest-GroupsV320Test-324748456 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:24 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-292c0d7f-29e6-41e6-8de9-6baa4c57f2bb tempest-GroupsV320Test-324748456 None] Delete group completed successfully. Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Creating offline snapshot 121e8712-6cdf-4601-93ae-ea723fdf5ae4 of volume 3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[38406142-543e-4d09-8a1b-6e6b2d94ed51]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:25 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 Apr 15 13:35:25 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:25 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" returned: 0 in 0.758s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:25 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 1G Apr 15 13:35:25 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:26 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 1G" returned: 0 in 0.551s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:26 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 Apr 15 13:35:26 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:26 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4" returned: 0 in 0.594s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:26 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 is being set with open permissions: ugo+rw Apr 15 13:35:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:26 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 Apr 15 13:35:26 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:27 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4" returned: 0 in 0.589s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:27 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.info Apr 15 13:35:27 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:28 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.info" returned: 0 in 0.511s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:28 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.info is being set with open permissions: ugo+rw Apr 15 13:35:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:28 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.info Apr 15 13:35:28 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:28 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.info" returned: 0 in 0.644s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.743s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:28 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-01fa36dd-66c0-4bd1-8e35-7464352c32a8 req-c5016c7c-70dc-4cdf-a859-a6600a7f9488 tempest-VolumesSnapshotsTestJSON-45959941 None] Create snapshot completed successfully Apr 15 13:35:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Acquiring lock "cinder-121e8712-6cdf-4601-93ae-ea723fdf5ae4-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "cinder-121e8712-6cdf-4601-93ae-ea723fdf5ae4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Acquiring lock "cinder-quobyte-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "cinder-quobyte-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Acquiring lock "cinder-quobyte-121e8712-6cdf-4601-93ae-ea723fdf5ae4" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "cinder-quobyte-121e8712-6cdf-4601-93ae-ea723fdf5ae4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:29 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Deleting offline snapshot 121e8712-6cdf-4601-93ae-ea723fdf5ae4 of volume 3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:35:29 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] snapshot_file for this snap is: volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:35:29 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bc3148-5ab2-4d82-950d-966247e8fc11]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:29 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 Apr 15 13:35:29 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:30 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4" returned: 0 in 0.610s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:35:30 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5ed7a8-230a-491c-82af-641565afd4be]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:30 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 Apr 15 13:35:30 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:30 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" returned: 0 in 0.569s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:30 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 Apr 15 13:35:30 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:31 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4" returned: 0 in 0.489s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:31 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4 Apr 15 13:35:31 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:32 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4.121e8712-6cdf-4601-93ae-ea723fdf5ae4" returned: 0 in 0.701s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "cinder-quobyte-121e8712-6cdf-4601-93ae-ea723fdf5ae4" released by "_delete_snapshot" :: held 2.436s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "cinder-quobyte-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" released by "delete_snapshot" :: held 2.453s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG cinder.quota [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Created reservations ['26a58198-a736-4ecf-abfa-dffbe4b17027', 'e56f79e7-fd65-4d8c-929d-a8d95dde4b7c', '1d83e3ec-e3ec-425b-bdd7-d7a65a34f5db', 'd9069585-d33c-4166-8ee5-4a3ca5649471'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:32 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Delete snapshot completed successfully. Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-e37aa472-f693-4e2b-ab01-f36c80600ac9 req-1a688956-2578-4307-95d4-f17a721dbb20 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "cinder-121e8712-6cdf-4601-93ae-ea723fdf5ae4-delete_snapshot" released by "delete_snapshot" :: held 2.613s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Acquiring lock "cinder-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "cinder-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Acquiring lock "cinder-quobyte-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "cinder-quobyte-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c659cf-89f3-40a1-a43c-3a195d83b7cb]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:33 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 Apr 15 13:35:33 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:33 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" returned: 0 in 0.656s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:33 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4 Apr 15 13:35:33 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:34 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" returned: 0 in 0.526s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "cinder-quobyte-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4" released by "delete_volume" :: held 1.216s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG cinder.quota [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Created reservations ['3ada0d5b-5c12-42b5-9062-7238495dfc47', '2ab87fc7-c6d4-4d2a-8f3d-7fb8091891e8', '19d302de-12da-46ac-8310-eaccde064994', '4e332adb-93f6-4b4a-bc01-3aecd8a556a9'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:34 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:34 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:34 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.468s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG cinder.manager [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:34 devstack cinder-volume[82595]: INFO cinder.volume.manager [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Deleted volume successfully. Apr 15 13:35:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [req-5729a8f0-982d-4acf-acb1-89e989125954 req-72989304-4c7e-4f70-8d27-b4023b6c74e4 tempest-VolumesSnapshotsTestJSON-45959941 None] Lock "cinder-3ffa88e5-0f5d-41ae-8afd-1502dae6f1e4-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Flow 'volume_create_manager' (8a36e5d5-914e-46a9-a517-9335dfdb33dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a363bb-cb23-4585-b0b8-b14751d08c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a363bb-cb23-4585-b0b8-b14751d08c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-782738313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01e1a31-5742-4d70-ac85-1498aff054c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67145f161f14868b1619d4392ac1798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:35Z,use_quota=True,user_id='67aa3c5f92dd47a196a0880657b4e1b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74f81cd-2a0b-49c5-890f-52796d4b2c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74f81cd-2a0b-49c5-890f-52796d4b2c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425eb63e-858b-4ece-aa08-0d592fd12bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425eb63e-858b-4ece-aa08-0d592fd12bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e01e1a31-5742-4d70-ac85-1498aff054c8', 'volume_name': 'volume-e01e1a31-5742-4d70-ac85-1498aff054c8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8def173-db34-4232-93f2-950e296dac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8def173-db34-4232-93f2-950e296dac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04cfa88-c663-4144-93b5-e98eaa7e1798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:35 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Volume e01e1a31-5742-4d70-ac85-1498aff054c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e01e1a31-5742-4d70-ac85-1498aff054c8', 'volume_size': 1} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-782738313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01e1a31-5742-4d70-ac85-1498aff054c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67145f161f14868b1619d4392ac1798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:35Z,use_quota=True,user_id='67aa3c5f92dd47a196a0880657b4e1b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Creating volume e01e1a31-5742-4d70-ac85-1498aff054c8 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:35 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:35 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8 1073741824 Apr 15 13:35:35 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:36 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8 1073741824" returned: 0 in 0.564s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:36 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8 Apr 15 13:35:36 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:36 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8" returned: 0 in 0.502s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04cfa88-c663-4144-93b5-e98eaa7e1798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01e1a31-5742-4d70-ac85-1498aff054c8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fc4489-7e42-4e31-92a4-f79de787afe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:36 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Volume volume-e01e1a31-5742-4d70-ac85-1498aff054c8 (e01e1a31-5742-4d70-ac85-1498aff054c8): created successfully Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fc4489-7e42-4e31-92a4-f79de787afe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Flow 'volume_create_manager' (8a36e5d5-914e-46a9-a517-9335dfdb33dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:36 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a40cd916-1371-4fb0-8b7b-47e6e7515ea8 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Created volume successfully. Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Flow 'volume_create_manager' (9735d8b2-59ea-45d7-874c-8842f9b2acf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a3973b-00d1-4363-a417-9c8f0acb2940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a3973b-00d1-4363-a417-9c8f0acb2940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-138755449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af19ed7f-77a4-4cf4-8b07-5fb77e31da76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f2923e378f41a3ad2826d035781858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:37Z,use_quota=True,user_id='cd4d7816b35f41e187cf2dbbe0857ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df61890c-67c8-47e2-8ec3-e7696125924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df61890c-67c8-47e2-8ec3-e7696125924b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee783a3-a098-40b3-8454-7fded9634f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee783a3-a098-40b3-8454-7fded9634f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af19ed7f-77a4-4cf4-8b07-5fb77e31da76', 'volume_name': 'volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8673c7-3b82-44fd-bff5-63010317d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8673c7-3b82-44fd-bff5-63010317d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31dbd24-42c4-474a-a062-de7af6d269da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:36 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Volume af19ed7f-77a4-4cf4-8b07-5fb77e31da76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76', 'volume_size': 1} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-138755449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af19ed7f-77a4-4cf4-8b07-5fb77e31da76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f2923e378f41a3ad2826d035781858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:37Z,use_quota=True,user_id='cd4d7816b35f41e187cf2dbbe0857ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Creating volume af19ed7f-77a4-4cf4-8b07-5fb77e31da76 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:36 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:36 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76 1073741824 Apr 15 13:35:36 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:37 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76 1073741824" returned: 0 in 0.544s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:37 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76 Apr 15 13:35:37 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:38 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76" returned: 0 in 0.502s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31dbd24-42c4-474a-a062-de7af6d269da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7de3d57-1109-4371-9e77-a192ec65c862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:38 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Volume volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76 (af19ed7f-77a4-4cf4-8b07-5fb77e31da76): created successfully Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7de3d57-1109-4371-9e77-a192ec65c862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Flow 'volume_create_manager' (9735d8b2-59ea-45d7-874c-8842f9b2acf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:38 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-52f19620-6b01-4a47-bfd0-7f5b2ab469ce tempest-AbsoluteLimitsTests-949525275 None] Created volume successfully. Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Acquiring lock "cinder-e01e1a31-5742-4d70-ac85-1498aff054c8-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Lock "cinder-e01e1a31-5742-4d70-ac85-1498aff054c8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Acquiring lock "cinder-quobyte-e01e1a31-5742-4d70-ac85-1498aff054c8" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Lock "cinder-quobyte-e01e1a31-5742-4d70-ac85-1498aff054c8" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31099f-d340-4e76-b9e6-0a4e2082fd28]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:38 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8 Apr 15 13:35:38 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6f8f84d3-7cd5-40f4-b6da-2becd94ac993 tempest-BackendsCapabilitiesAdminTestsJSON-1694978339 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953468322754, 'free_capacity_gb': 1775.6953468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82595) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 13:35:38 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8" returned: 0 in 0.533s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:38 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8 Apr 15 13:35:38 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6559420-2582-462f-a9a3-53c3ef0bab1a tempest-BackendsCapabilitiesAdminTestsJSON-1694978339 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953468322754, 'free_capacity_gb': 1775.6953468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82595) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Acquiring lock "cinder-af19ed7f-77a4-4cf4-8b07-5fb77e31da76-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Lock "cinder-af19ed7f-77a4-4cf4-8b07-5fb77e31da76-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Acquiring lock "cinder-quobyte-af19ed7f-77a4-4cf4-8b07-5fb77e31da76" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Lock "cinder-quobyte-af19ed7f-77a4-4cf4-8b07-5fb77e31da76" acquired by "delete_volume" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca51e34-982f-46f2-b3d3-9a4266319f34]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:39 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e01e1a31-5742-4d70-ac85-1498aff054c8" returned: 0 in 0.553s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Lock "cinder-quobyte-e01e1a31-5742-4d70-ac85-1498aff054c8" released by "delete_volume" :: held 1.111s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:39 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76 Apr 15 13:35:39 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Created reservations ['e30d4fbb-99b1-4b07-aeb0-8f39cfcc61bc', '58ee999d-c703-4d3a-a876-96c27892f5ee', '62fd6719-3b5a-4b5c-b8d6-dbfa0086fc2f', 'ca21da1e-a9ad-45e7-b357-3557477b9efa'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:39 devstack sudo[86871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:39 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:39 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76" returned: 0 in 0.612s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:39 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76 Apr 15 13:35:39 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:40 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.534s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:40 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Deleted volume successfully. Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-383f796d-18d7-41dc-bde6-add14769ac43 tempest-VolumeQuotasNegativeTestJSON-1656470246 None] Lock "cinder-e01e1a31-5742-4d70-ac85-1498aff054c8-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:40 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-af19ed7f-77a4-4cf4-8b07-5fb77e31da76" returned: 0 in 0.593s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Lock "cinder-quobyte-af19ed7f-77a4-4cf4-8b07-5fb77e31da76" released by "delete_volume" :: held 1.238s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Created reservations ['a01c4327-4f6f-4392-9aae-e0c3473011c7', 'daebc919-29fa-49a3-aaae-67ab3c89660f', '66260f43-bdbe-40cc-8f7d-c0d5f672643e', 'af19546b-d629-4da5-8231-0f34dd508eb3'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:40 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:40 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:41 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.568s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:41 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:41 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Deleted volume successfully. Apr 15 13:35:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-75c61390-76ce-4968-8447-67e7b94673c3 tempest-AbsoluteLimitsTests-949525275 None] Lock "cinder-af19ed7f-77a4-4cf4-8b07-5fb77e31da76-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:43 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-de56a79d-2681-4e5e-86bd-91f90c7a2420 tempest-GroupSnapshotsTest-1876803718 None] Group tempest-GroupSnapshotsTest-Group-918973492: creating Apr 15 13:35:43 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-de56a79d-2681-4e5e-86bd-91f90c7a2420 tempest-GroupSnapshotsTest-1876803718 None] Group tempest-GroupSnapshotsTest-Group-918973492: created successfully Apr 15 13:35:43 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-de56a79d-2681-4e5e-86bd-91f90c7a2420 tempest-GroupSnapshotsTest-1876803718 None] Create group completed successfully. Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Flow 'volume_create_manager' (a02867b2-566e-443f-98f8-67651521601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0f3e8e-b8d1-465d-ad5c-e20a3f739608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0f3e8e-b8d1-465d-ad5c-e20a3f739608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-794564670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2640209a-b2ee-4bee-83bf-4e03141c4548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2b37f2bb364a4bb07d317f652bea40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:45Z,use_quota=True,user_id='fee6032318274aedb1456a826ca2c308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e28a71a-d4fc-43c1-bce6-26e3c3b8e2b4),volume_type_id=8e28a71a-d4fc-43c1-bce6-26e3c3b8e2b4)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdc4ff2-33f2-49ec-a0ea-e794633d8016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdc4ff2-33f2-49ec-a0ea-e794633d8016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a83ff23-1328-4dbe-9b1f-8964ada58673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a83ff23-1328-4dbe-9b1f-8964ada58673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2640209a-b2ee-4bee-83bf-4e03141c4548', 'volume_name': 'volume-2640209a-b2ee-4bee-83bf-4e03141c4548', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e624cd6-21e6-47db-ba7b-849bce8a9e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e624cd6-21e6-47db-ba7b-849bce8a9e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131d26fb-2623-4fe9-a9e8-c12f72062dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:44 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Volume 2640209a-b2ee-4bee-83bf-4e03141c4548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2640209a-b2ee-4bee-83bf-4e03141c4548', 'volume_size': 1} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-794564670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2640209a-b2ee-4bee-83bf-4e03141c4548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2b37f2bb364a4bb07d317f652bea40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:45Z,use_quota=True,user_id='fee6032318274aedb1456a826ca2c308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e28a71a-d4fc-43c1-bce6-26e3c3b8e2b4),volume_type_id=8e28a71a-d4fc-43c1-bce6-26e3c3b8e2b4)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Creating volume 2640209a-b2ee-4bee-83bf-4e03141c4548 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:44 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:44 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548 1073741824 Apr 15 13:35:44 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Flow 'volume_create_manager' (b0b9b8e9-df4e-4a6d-9fea-72f437711b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec26f4e-99ea-4001-826c-7461362947b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec26f4e-99ea-4001-826c-7461362947b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1487285645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6cc0759c-067c-4ca3-8ae3-92e1b6795991,host='devstack@QuobyteHD#QuobyteHD',id=53add8dd-d7c7-44bd-b3f7-48f127b8d847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba64cc4461c4cdd967169860f6edced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:45Z,use_quota=True,user_id='69c532db8662409980f93aeecadedf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4fee043-b5e4-4f76-8942-784e55571fb1),volume_type_id=a4fee043-b5e4-4f76-8942-784e55571fb1)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbe3405-b411-4f8d-a9e5-706da1330943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbe3405-b411-4f8d-a9e5-706da1330943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea822ba-3d64-427f-9f26-e1920d59ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea822ba-3d64-427f-9f26-e1920d59ba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53add8dd-d7c7-44bd-b3f7-48f127b8d847', 'volume_name': 'volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19634ebf-5ac1-4c1b-8689-65a193bf70dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19634ebf-5ac1-4c1b-8689-65a193bf70dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070c8647-acba-4bb3-ae87-42e9ec1a6620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:45 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Volume 53add8dd-d7c7-44bd-b3f7-48f127b8d847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847', 'volume_size': 1} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Flow 'volume_create_manager' (39d947a8-9497-4a70-959e-7d1696817a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ef0b15-f77f-4536-a6ea-e99ad24f8725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ef0b15-f77f-4536-a6ea-e99ad24f8725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1554261850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845bdd0a-8e2d-4870-834f-5a47dae74fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4fc6d1280c4da7a3e4680127f4d6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:45Z,use_quota=True,user_id='d40957773c844de5955b498ef4ad58da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a6a36a-e7c4-4167-b213-0644aea21480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a6a36a-e7c4-4167-b213-0644aea21480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab10006-23bc-401e-a514-d73a46a936d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab10006-23bc-401e-a514-d73a46a936d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '845bdd0a-8e2d-4870-834f-5a47dae74fe2', 'volume_name': 'volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1b3257-89be-4d4e-aacc-805d321c7c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1b3257-89be-4d4e-aacc-805d321c7c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d2a0df-3a3b-4919-9754-53187c5718fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:45 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Volume 845bdd0a-8e2d-4870-834f-5a47dae74fe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2', 'volume_size': 1} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:45 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548 1073741824" returned: 0 in 0.845s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:45 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548 Apr 15 13:35:45 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:46 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548" returned: 0 in 0.450s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6cc0759c-067c-4ca3-8ae3-92e1b6795991,created_at=2026-04-15T11:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1487285645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6cc0759c-067c-4ca3-8ae3-92e1b6795991,host='devstack@QuobyteHD#QuobyteHD',id=53add8dd-d7c7-44bd-b3f7-48f127b8d847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba64cc4461c4cdd967169860f6edced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:45Z,use_quota=True,user_id='69c532db8662409980f93aeecadedf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4fee043-b5e4-4f76-8942-784e55571fb1),volume_type_id=a4fee043-b5e4-4f76-8942-784e55571fb1)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Creating volume 53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:46 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131d26fb-2623-4fe9-a9e8-c12f72062dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2640209a-b2ee-4bee-83bf-4e03141c4548', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7651609c-b3d8-4ee9-a1cb-61dbf6249f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:46 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 1073741824 Apr 15 13:35:46 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:46 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Volume volume-2640209a-b2ee-4bee-83bf-4e03141c4548 (2640209a-b2ee-4bee-83bf-4e03141c4548): created successfully Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7651609c-b3d8-4ee9-a1cb-61dbf6249f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Flow 'volume_create_manager' (a02867b2-566e-443f-98f8-67651521601d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:46 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-532ccb69-70c7-4af8-9d23-a300f56ff1a7 tempest-VolumeTypesAccessTest-1847332372 None] Created volume successfully. Apr 15 13:35:46 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 1073741824" returned: 0 in 0.497s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:46 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 Apr 15 13:35:46 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Acquiring lock "cinder-2640209a-b2ee-4bee-83bf-4e03141c4548-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Lock "cinder-2640209a-b2ee-4bee-83bf-4e03141c4548-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Acquiring lock "cinder-quobyte-2640209a-b2ee-4bee-83bf-4e03141c4548" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Lock "cinder-quobyte-2640209a-b2ee-4bee-83bf-4e03141c4548" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e736b6-e749-4879-bec6-f7340f30e8d7]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:47 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548 Apr 15 13:35:47 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:47 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847" returned: 0 in 0.574s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.906s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1554261850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845bdd0a-8e2d-4870-834f-5a47dae74fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4fc6d1280c4da7a3e4680127f4d6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:45Z,use_quota=True,user_id='d40957773c844de5955b498ef4ad58da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Creating volume 845bdd0a-8e2d-4870-834f-5a47dae74fe2 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:47 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070c8647-acba-4bb3-ae87-42e9ec1a6620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6fb9b0-9dab-4e15-8e7b-3f1b5d44023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:47 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2 1073741824 Apr 15 13:35:47 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:47 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Volume volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 (53add8dd-d7c7-44bd-b3f7-48f127b8d847): created successfully Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6fb9b0-9dab-4e15-8e7b-3f1b5d44023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Flow 'volume_create_manager' (b0b9b8e9-df4e-4a6d-9fea-72f437711b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (ef3de064-0537-4e89-a969-fadc0c5b9be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2836e82c-d392-41b5-b473-85c3ad576333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2836e82c-d392-41b5-b473-85c3ad576333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-160942145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6387f693-e893-4f23-b335-051ce1567ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:47Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f23cb5-9e81-4bbd-b825-b99cc1fd0988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f23cb5-9e81-4bbd-b825-b99cc1fd0988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedbfe4e-d987-4c99-8f7e-9526befff679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedbfe4e-d987-4c99-8f7e-9526befff679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6387f693-e893-4f23-b335-051ce1567ac6', 'volume_name': 'volume-6387f693-e893-4f23-b335-051ce1567ac6', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398a413d-2184-4334-9371-0d2d39ae61ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398a413d-2184-4334-9371-0d2d39ae61ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e98f6ee-884f-4d88-b8fa-26778962f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:47 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Volume 6387f693-e893-4f23-b335-051ce1567ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6387f693-e893-4f23-b335-051ce1567ac6', 'volume_size': 1} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:47 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9d5bfb60-bfa4-40ca-bfe5-127fd06a49fc tempest-GroupSnapshotsTest-1876803718 None] Created volume successfully. Apr 15 13:35:47 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548" returned: 0 in 0.571s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:47 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548 Apr 15 13:35:47 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:47 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2 1073741824" returned: 0 in 0.568s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:47 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2 Apr 15 13:35:47 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:48 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2640209a-b2ee-4bee-83bf-4e03141c4548" returned: 0 in 0.463s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Lock "cinder-quobyte-2640209a-b2ee-4bee-83bf-4e03141c4548" released by "delete_volume" :: held 1.074s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:48 devstack cinder-volume[82595]: WARNING cinder.quota [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1376954264 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1376954264, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:35:48 devstack cinder-volume[82595]: WARNING cinder.quota [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1376954264 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1376954264, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Created reservations ['0a81089c-7f0a-4209-b8a2-82a67fd1bf13', '7c3a1445-4a8c-4aba-bf1a-f25cc66d3568', '91ffae8f-0559-4c3b-b04b-3ed3952915a7', '549e2d1d-0245-4b45-b554-a1cfb2b53357'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:48 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:48 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:48 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] GroupSnapshot 29d789ca-e7d6-4354-a9c2-1905c23caed9: creating. Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Group snapshot 29d789ca-e7d6-4354-a9c2-1905c23caed9: creating. {{(pid=82595) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:48 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2" returned: 0 in 0.531s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.906s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-160942145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6387f693-e893-4f23-b335-051ce1567ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:47Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Creating volume 6387f693-e893-4f23-b335-051ce1567ac6 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:48 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:48 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6 1073741824 Apr 15 13:35:48 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d2a0df-3a3b-4919-9754-53187c5718fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316ea16c-fe61-4d91-a82d-65e62e0fe36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:48 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Volume volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2 (845bdd0a-8e2d-4870-834f-5a47dae74fe2): created successfully Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316ea16c-fe61-4d91-a82d-65e62e0fe36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Flow 'volume_create_manager' (39d947a8-9497-4a70-959e-7d1696817a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:48 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0526a0da-25c7-44ae-8cca-2284889f5e5b tempest-VolumesTransfersV357Test-849957028 None] Created volume successfully. Apr 15 13:35:48 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.437s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:48 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Deleted volume successfully. Apr 15 13:35:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a9a38d05-2224-43fd-8ae2-e7b639f7ee62 tempest-VolumeTypesAccessTest-1847332372 None] Lock "cinder-2640209a-b2ee-4bee-83bf-4e03141c4548-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:49 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6 1073741824" returned: 0 in 0.506s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:49 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6 Apr 15 13:35:49 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:49 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6" returned: 0 in 0.506s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.262s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Creating offline snapshot 16569d39-809f-4dcf-8a85-d8b50a498f8b of volume 53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e98f6ee-884f-4d88-b8fa-26778962f968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6387f693-e893-4f23-b335-051ce1567ac6', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae9d04a-2810-4d5a-b3bd-9dfee39a6ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[674a8e50-b108-4551-926a-c1aee17bac83]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:49 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Volume volume-6387f693-e893-4f23-b335-051ce1567ac6 (6387f693-e893-4f23-b335-051ce1567ac6): created successfully Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae9d04a-2810-4d5a-b3bd-9dfee39a6ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (ef3de064-0537-4e89-a969-fadc0c5b9be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:49 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9374f373-d41e-4309-bfb7-7b979c9fbed6 tempest-VolumesActionsTest-732107519 None] Created volume successfully. Apr 15 13:35:49 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 Apr 15 13:35:49 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:50 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847" returned: 0 in 0.622s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:50 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a0927f7f-c1d7-45b7-92bd-9f6837db35cf tempest-VolumesTransfersV357Test-1483228462 None] Transfer volume completed successfully. Apr 15 13:35:50 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b 1G Apr 15 13:35:50 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6bbafb30-ef51-4d88-b6e9-89642fc9502e tempest-VolumesActionsTest-732107519 None] Acquiring lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6" by "attach_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6bbafb30-ef51-4d88-b6e9-89642fc9502e tempest-VolumesActionsTest-732107519 None] Lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6" acquired by "attach_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:50 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6bbafb30-ef51-4d88-b6e9-89642fc9502e tempest-VolumesActionsTest-732107519 None] Attaching volume 6387f693-e893-4f23-b335-051ce1567ac6 to instance 5375b6b2-1d8b-48e9-afb2-5683568a9b6c at mountpoint /dev/vdb on host None. Apr 15 13:35:50 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6bbafb30-ef51-4d88-b6e9-89642fc9502e tempest-VolumesActionsTest-732107519 None] Attach volume completed successfully. Apr 15 13:35:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6bbafb30-ef51-4d88-b6e9-89642fc9502e tempest-VolumesActionsTest-732107519 None] Lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6" released by "attach_volume" :: held 0.084s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:50 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b 1G" returned: 0 in 0.674s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:50 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b Apr 15 13:35:50 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Acquiring lock "cinder-845bdd0a-8e2d-4870-834f-5a47dae74fe2-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Lock "cinder-845bdd0a-8e2d-4870-834f-5a47dae74fe2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Acquiring lock "cinder-quobyte-845bdd0a-8e2d-4870-834f-5a47dae74fe2" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Lock "cinder-quobyte-845bdd0a-8e2d-4870-834f-5a47dae74fe2" acquired by "delete_volume" :: waited 0.036s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:51 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8be74e-30c7-40df-902a-44a14670a8a1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:51 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2 Apr 15 13:35:51 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:51 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b" returned: 0 in 0.881s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:51 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-391524c8-56ea-476f-a48b-607b6f6c51e3 tempest-VolumesActionsTest-417517530 None] Terminate volume connection completed successfully. Apr 15 13:35:51 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:35:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:51 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b Apr 15 13:35:51 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:51 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2" returned: 0 in 0.613s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:51 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2 Apr 15 13:35:51 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-391524c8-56ea-476f-a48b-607b6f6c51e3 tempest-VolumesActionsTest-417517530 None] Acquiring lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6-detach_volume" by "detach_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-391524c8-56ea-476f-a48b-607b6f6c51e3 tempest-VolumesActionsTest-417517530 None] Lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:52 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-391524c8-56ea-476f-a48b-607b6f6c51e3 tempest-VolumesActionsTest-417517530 None] Detaching volume 6387f693-e893-4f23-b335-051ce1567ac6 from instance 5375b6b2-1d8b-48e9-afb2-5683568a9b6c. Apr 15 13:35:52 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b" returned: 0 in 0.613s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:52 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.info Apr 15 13:35:52 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:52 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-391524c8-56ea-476f-a48b-607b6f6c51e3 tempest-VolumesActionsTest-417517530 None] Detach volume completed successfully. Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-391524c8-56ea-476f-a48b-607b6f6c51e3 tempest-VolumesActionsTest-417517530 None] Lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6-detach_volume" released by "detach_volume" :: held 0.133s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:52 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-845bdd0a-8e2d-4870-834f-5a47dae74fe2" returned: 0 in 0.537s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Lock "cinder-quobyte-845bdd0a-8e2d-4870-834f-5a47dae74fe2" released by "delete_volume" :: held 1.176s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Created reservations ['3b62f153-577a-4d88-a71a-88f0ad4577c8', 'a594f761-ba19-4888-b373-555cadb95bd4', '0a79e985-5274-46fd-92d0-dc1182d003f8', 'e5cb97c8-7d30-420a-9447-450e779ea28b'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:52 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:52 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:52 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-aa6dec44-ab11-49c7-901f-a5cd363302f7 tempest-VolumesActionsTest-732107519 None] Acquiring lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6-detach_volume" by "detach_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.info" returned: 0 in 0.591s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:53 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-aa6dec44-ab11-49c7-901f-a5cd363302f7 tempest-VolumesActionsTest-732107519 None] Lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:53 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-aa6dec44-ab11-49c7-901f-a5cd363302f7 tempest-VolumesActionsTest-732107519 None] Volume detach called, but volume not attached. Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-aa6dec44-ab11-49c7-901f-a5cd363302f7 tempest-VolumesActionsTest-732107519 None] Lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:53 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.info Apr 15 13:35:53 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:53 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.598s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:53 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Deleted volume successfully. Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ea4ba8bd-bc9a-4977-b5ad-d2632df5879f tempest-VolumesTransfersV357Test-8819575 None] Lock "cinder-845bdd0a-8e2d-4870-834f-5a47dae74fe2-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:53 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.info" returned: 0 in 0.521s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.991s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:53 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-73f08bc8-d2bc-4d71-9ba3-c1b031063c1b tempest-GroupSnapshotsTest-1876803718 None] group_snapshot 29d789ca-e7d6-4354-a9c2-1905c23caed9: created successfully Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Acquiring lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Acquiring lock "cinder-quobyte-6387f693-e893-4f23-b335-051ce1567ac6" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Lock "cinder-quobyte-6387f693-e893-4f23-b335-051ce1567ac6" acquired by "delete_volume" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f92ce0-bef9-470f-b0b3-6cbf546de33b]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:53 devstack sudo[87048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6 Apr 15 13:35:53 devstack sudo[87048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Flow 'volume_create_manager' (a2d2e392-2cdc-4e31-8455-019a857c683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fe72c3-a98e-4740-981f-72e7b2e9f70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fe72c3-a98e-4740-981f-72e7b2e9f70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-880491035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8f3538-935f-4914-af3b-bdc8828d4e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4fc6d1280c4da7a3e4680127f4d6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:54Z,use_quota=True,user_id='d40957773c844de5955b498ef4ad58da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef255b3-d565-48e3-9611-32597074fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef255b3-d565-48e3-9611-32597074fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f9b29b-7f9a-41dd-a427-09973072dee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f9b29b-7f9a-41dd-a427-09973072dee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8f3538-935f-4914-af3b-bdc8828d4e6d', 'volume_name': 'volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3c26b2-8a41-49f2-b774-ae329671ec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3c26b2-8a41-49f2-b774-ae329671ec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2016adfe-e04e-44fa-8121-8f4764255570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:54 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Volume 1b8f3538-935f-4914-af3b-bdc8828d4e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d', 'volume_size': 1} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-880491035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8f3538-935f-4914-af3b-bdc8828d4e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4fc6d1280c4da7a3e4680127f4d6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:35:54Z,use_quota=True,user_id='d40957773c844de5955b498ef4ad58da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Creating volume 1b8f3538-935f-4914-af3b-bdc8828d4e6d {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:54 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:54 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d 1073741824 Apr 15 13:35:54 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:54 devstack sudo[87048]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6" returned: 0 in 0.587s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:54 devstack sudo[87055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6 Apr 15 13:35:54 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:54 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d 1073741824" returned: 0 in 0.672s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:54 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d Apr 15 13:35:54 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:54 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-6387f693-e893-4f23-b335-051ce1567ac6" returned: 0 in 0.593s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Lock "cinder-quobyte-6387f693-e893-4f23-b335-051ce1567ac6" released by "delete_volume" :: held 1.207s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Created reservations ['b6e49d3e-dbda-4882-b296-eadada622a23', '289c27b9-fd17-4518-ad84-fd0116f1ab62', '1dbb0691-3f51-4abe-a807-7d2ce6eed4c2', 'eb799f88-127c-4039-a7fa-ab5602fe3d17'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:55 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:55 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:55 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d" returned: 0 in 0.620s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2016adfe-e04e-44fa-8121-8f4764255570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce681aca-d082-42e6-9d91-327bba6c74b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:35:55 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Volume volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d (1b8f3538-935f-4914-af3b-bdc8828d4e6d): created successfully Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce681aca-d082-42e6-9d91-327bba6c74b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Flow 'volume_create_manager' (a2d2e392-2cdc-4e31-8455-019a857c683b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:35:55 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-76628efc-d54a-4069-82cb-78b50d61d165 tempest-VolumesTransfersV357Test-849957028 None] Created volume successfully. Apr 15 13:35:55 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.563s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:55 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Deleted volume successfully. Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-16569d39-809f-4dcf-8a85-d8b50a498f8b-27bbfab2-7555-4594-b090-9daa43caaf29" by "_create_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-16569d39-809f-4dcf-8a85-d8b50a498f8b-27bbfab2-7555-4594-b090-9daa43caaf29" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Creating volume 27bbfab2-7555-4594-b090-9daa43caaf29 from snapshot 16569d39-809f-4dcf-8a85-d8b50a498f8b {{(pid=82595) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-27bbfab2-7555-4594-b090-9daa43caaf29" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-069bd7c0-48d7-4fed-ac0c-6b3379fce4b7 tempest-VolumesActionsTest-732107519 None] Lock "cinder-6387f693-e893-4f23-b335-051ce1567ac6-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-27bbfab2-7555-4594-b090-9daa43caaf29" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] snapshot: 16569d39-809f-4dcf-8a85-d8b50a498f8b, volume: 27bbfab2-7555-4594-b090-9daa43caaf29, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bce251-b1ea-432d-b7eb-e21371f817df]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:55 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b Apr 15 13:35:55 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Acquiring lock "cinder-1b8f3538-935f-4914-af3b-bdc8828d4e6d-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Lock "cinder-1b8f3538-935f-4914-af3b-bdc8828d4e6d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Acquiring lock "cinder-quobyte-1b8f3538-935f-4914-af3b-bdc8828d4e6d" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Lock "cinder-quobyte-1b8f3538-935f-4914-af3b-bdc8828d4e6d" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4acff0-b7d9-4173-976a-02c5529d8267]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:56 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b" returned: 0 in 0.850s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62f488a-ddb4-4073-8db3-65727f579a9d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:56 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d Apr 15 13:35:56 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:56 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 Apr 15 13:35:56 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:57 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847" returned: 0 in 0.580s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:57 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:35:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:57 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 Apr 15 13:35:57 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:57 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d" returned: 0 in 0.696s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:57 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d Apr 15 13:35:57 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:57 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b8f3538-935f-4914-af3b-bdc8828d4e6d" returned: 0 in 0.621s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Lock "cinder-quobyte-1b8f3538-935f-4914-af3b-bdc8828d4e6d" released by "delete_volume" :: held 1.348s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:58 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Created reservations ['1aff7c15-b8d9-4207-9538-3c10b6e77c23', '06f201d4-ad92-49bd-a4fb-71b8603a3fc5', '0e5b7458-91d6-43fb-a629-b4b08287cfb2', 'f033eca9-f4ee-417d-897f-f6d6036854c7'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:35:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:35:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:35:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:35:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:35:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:35:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:35:58 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:35:58 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:35:59 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 1.554s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:59 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:35:59 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Deleted volume successfully. Apr 15 13:35:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2e67243e-4cdb-4087-80b4-9564a7808c63 tempest-VolumesTransfersV357Test-8819575 None] Lock "cinder-1b8f3538-935f-4914-af3b-bdc8828d4e6d-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:35:59 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 15 13:35:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29" returned: 0 in 2.788s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:35:59 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[827b6a04-c7b1-4d66-817e-b2375b6ce41a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:35:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:00 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 Apr 15 13:36:00 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:00 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847" returned: 0 in 0.767s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:00 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847, size 1024.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:36:00 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Converted 1024.00 MB image at 367.16 MB/s Apr 15 13:36:00 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:36:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:00 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 Apr 15 13:36:00 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:01 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-27bbfab2-7555-4594-b090-9daa43caaf29" released by "_copy_volume_from_snapshot" :: held 5.525s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-16569d39-809f-4dcf-8a85-d8b50a498f8b-27bbfab2-7555-4594-b090-9daa43caaf29" released by "_create_volume_from_snapshot" :: held 5.559s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.577s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:01 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0f5b97b3-2ab0-4294-abd3-a890ded67b3f tempest-GroupSnapshotsTest-1876803718 None] Create group from source-snapshot-29d789ca-e7d6-4354-a9c2-1905c23caed9 completed successfully. Apr 15 13:36:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-27bbfab2-7555-4594-b090-9daa43caaf29" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-27bbfab2-7555-4594-b090-9daa43caaf29" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:01 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c845286-c455-4f63-890b-d23c4f818fef]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:01 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 Apr 15 13:36:01 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:02 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29" returned: 0 in 0.566s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:02 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29 Apr 15 13:36:02 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:02 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27bbfab2-7555-4594-b090-9daa43caaf29" returned: 0 in 0.513s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-27bbfab2-7555-4594-b090-9daa43caaf29" released by "delete_volume" :: held 1.119s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:02 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['0442625d-a7f4-4a5a-bce0-1d0ce316c439'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:02 devstack cinder-volume[82595]: WARNING cinder.quota [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-168529483 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-168529483, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:36:02 devstack cinder-volume[82595]: WARNING cinder.quota [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-168529483 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-168529483, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:36:02 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['28bee201-b378-40a1-8f95-426360bb9f99', '1b5a3ad1-435e-4691-b716-20208e5e3d57', '1fd2d063-411e-4d1f-8ade-078541119e4f', 'cf563d8e-a19f-4d8c-ab75-7f04cbeb90cd'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:02 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:UPDATE=154,cinder:SELECT=169,cinder:INSERT=37,cinder:DELETE=11 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:03 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:03 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Flow 'volume_create_manager' (30c66118-ebeb-4b8e-b7d5-f77a948846f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a9bb33-b952-4b24-9d3a-cd658fa67965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a9bb33-b952-4b24-9d3a-cd658fa67965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-790341863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc8d416-4146-49f2-bbaf-9e7c7998f171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b949da3f0b46af96739c482ab1dafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:03Z,use_quota=True,user_id='132c4bfa393e45ea992049e72dd5b227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc28b550-ac7e-4fbb-a1cd-dae33052705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc28b550-ac7e-4fbb-a1cd-dae33052705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e554b08c-d3bd-4fe3-84c5-0c31262184ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e554b08c-d3bd-4fe3-84c5-0c31262184ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abc8d416-4146-49f2-bbaf-9e7c7998f171', 'volume_name': 'volume-abc8d416-4146-49f2-bbaf-9e7c7998f171', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710bf58d-f8f1-4be2-b29c-82ac04689aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710bf58d-f8f1-4be2-b29c-82ac04689aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1b902f-2f75-4315-ac9e-6996bbf72a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:03 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Volume abc8d416-4146-49f2-bbaf-9e7c7998f171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abc8d416-4146-49f2-bbaf-9e7c7998f171', 'volume_size': 1} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-790341863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc8d416-4146-49f2-bbaf-9e7c7998f171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b949da3f0b46af96739c482ab1dafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:03Z,use_quota=True,user_id='132c4bfa393e45ea992049e72dd5b227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Creating volume abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:03 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:03 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 1073741824 Apr 15 13:36:03 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Flow 'volume_create_manager' (5186a935-49f8-4467-b989-a649520257be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a54ba2a-8f09-4d37-9262-201480469518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a54ba2a-8f09-4d37-9262-201480469518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-621919667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ada0c1-bc7c-47b4-bc28-694e1a72b051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85016dff7e451ba86b63967221cd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:03Z,use_quota=True,user_id='b3c97a31c8614cc5bbf8386b148215f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad66ab2-d657-4f7f-a605-5d65854bb8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad66ab2-d657-4f7f-a605-5d65854bb8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8652ead9-931a-4ea0-b35d-ee3f01671554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8652ead9-931a-4ea0-b35d-ee3f01671554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ada0c1-bc7c-47b4-bc28-694e1a72b051', 'volume_name': 'volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6062ab-e897-4fb7-a95b-c3417c7a36d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6062ab-e897-4fb7-a95b-c3417c7a36d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9f6505-b199-4dd2-b0c4-db2636398ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:03 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Volume 70ada0c1-bc7c-47b4-bc28-694e1a72b051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051', 'volume_size': 1} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:03 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.502s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:03 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2ade0ddc-b258-461b-ae0d-9b54d40d8091 tempest-GroupSnapshotsTest-1876803718 None] Delete group completed successfully. Apr 15 13:36:03 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 1073741824" returned: 0 in 0.531s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:03 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 Apr 15 13:36:03 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=156,cinder:UPDATE=210,cinder:INSERT=47,cinder:DELETE=13 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:36:03 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (66f45c7a-dbe5-41ac-89f7-8a5c840b3121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fbdf68-2eb0-494b-8a8d-0afbabe51618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fbdf68-2eb0-494b-8a8d-0afbabe51618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1246239105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98672b3-1187-45d1-ae26-0fb08e821c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:04Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcd78ed-7b7a-4097-810d-58fee4627c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcd78ed-7b7a-4097-810d-58fee4627c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3608dd-d611-4e4b-a9ad-4e3a0bfe9e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3608dd-d611-4e4b-a9ad-4e3a0bfe9e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98672b3-1187-45d1-ae26-0fb08e821c85', 'volume_name': 'volume-b98672b3-1187-45d1-ae26-0fb08e821c85', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6346947f-de3e-4925-84d7-0a4eee7b6ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6346947f-de3e-4925-84d7-0a4eee7b6ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b239d9bd-50b4-4751-a72c-b3b5d4809791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:04 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Volume b98672b3-1187-45d1-ae26-0fb08e821c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98672b3-1187-45d1-ae26-0fb08e821c85', 'volume_size': 1} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:04 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot 29d789ca-e7d6-4354-a9c2-1905c23caed9: deleting Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot 29d789ca-e7d6-4354-a9c2-1905c23caed9: deleting {{(pid=82595) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-53add8dd-d7c7-44bd-b3f7-48f127b8d847" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-53add8dd-d7c7-44bd-b3f7-48f127b8d847" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-16569d39-809f-4dcf-8a85-d8b50a498f8b" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-16569d39-809f-4dcf-8a85-d8b50a498f8b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Deleting offline snapshot 16569d39-809f-4dcf-8a85-d8b50a498f8b of volume 53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] snapshot_file for this snap is: volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12b32b1-242c-4d81-93a1-a0297488fc08]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:04 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b Apr 15 13:36:04 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:04 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171" returned: 0 in 0.502s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-621919667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ada0c1-bc7c-47b4-bc28-694e1a72b051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85016dff7e451ba86b63967221cd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:03Z,use_quota=True,user_id='b3c97a31c8614cc5bbf8386b148215f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Creating volume 70ada0c1-bc7c-47b4-bc28-694e1a72b051 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:04 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:04 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051 1073741824 Apr 15 13:36:04 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1b902f-2f75-4315-ac9e-6996bbf72a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc8d416-4146-49f2-bbaf-9e7c7998f171', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2d3d1d-e532-4b16-a199-5fb54de52dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:04 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Volume volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 (abc8d416-4146-49f2-bbaf-9e7c7998f171): created successfully Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2d3d1d-e532-4b16-a199-5fb54de52dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Flow 'volume_create_manager' (30c66118-ebeb-4b8e-b7d5-f77a948846f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:04 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-7f96894f-edb8-4fbd-9a13-88efa193dfc8 tempest-VolumesCloneTest-311916453 None] Created volume successfully. Apr 15 13:36:04 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b" returned: 0 in 0.469s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8a44e5-deee-4a36-bcae-98140ba63cdc]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:04 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 Apr 15 13:36:04 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:04 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051 1073741824" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:04 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051 Apr 15 13:36:04 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:05 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847" returned: 0 in 0.475s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:05 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b Apr 15 13:36:05 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:05 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051" returned: 0 in 0.405s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.121s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1246239105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98672b3-1187-45d1-ae26-0fb08e821c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:04Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Creating volume b98672b3-1187-45d1-ae26-0fb08e821c85 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:05 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9f6505-b199-4dd2-b0c4-db2636398ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a283f56-2118-48f7-920a-178bd644237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85 1073741824 Apr 15 13:36:05 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:05 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Volume volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051 (70ada0c1-bc7c-47b4-bc28-694e1a72b051): created successfully Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a283f56-2118-48f7-920a-178bd644237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Flow 'volume_create_manager' (5186a935-49f8-4467-b989-a649520257be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:05 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9a233295-625b-4d59-b8c6-d82a7d5cfe17 tempest-VolumesListAdminTestJSON-803892001 None] Created volume successfully. Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Flow 'volume_create_manager' (0af361ad-a111-4cb4-b2cf-e173a8b106e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a395d408-a5e0-4091-afb0-15b86ff53f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a395d408-a5e0-4091-afb0-15b86ff53f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-562726585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67864033-f86a-4e55-969f-b8c671b12fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b949da3f0b46af96739c482ab1dafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=abc8d416-4146-49f2-bbaf-9e7c7998f171,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:06Z,use_quota=True,user_id='132c4bfa393e45ea992049e72dd5b227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5006a57-d37b-4011-87ed-dc0f72facb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5006a57-d37b-4011-87ed-dc0f72facb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b571d9a-8a74-4a40-848c-562aab78216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b" returned: 0 in 0.561s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b571d9a-8a74-4a40-848c-562aab78216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '67864033-f86a-4e55-969f-b8c671b12fe6', 'volume_name': 'volume-67864033-f86a-4e55-969f-b8c671b12fe6', 'volume_size': 2, 'source_volid': 'abc8d416-4146-49f2-bbaf-9e7c7998f171', 'source_volstatus': 'available'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:05 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b Apr 15 13:36:05 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf059526-8398-4d8a-a263-8dc93b4950b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf059526-8398-4d8a-a263-8dc93b4950b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f8546b-d64f-462d-9c61-fe09c9a047d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Volume 67864033-f86a-4e55-969f-b8c671b12fe6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-67864033-f86a-4e55-969f-b8c671b12fe6', 'volume_size': 2, 'source_volid': 'abc8d416-4146-49f2-bbaf-9e7c7998f171', 'source_volstatus': 'available'} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Flow 'volume_create_manager' (3cc70288-2207-42c5-8362-92c6785965a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f3b154-6162-46b3-ae78-eef5050b205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f3b154-6162-46b3-ae78-eef5050b205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1876518624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6cd6d2-cff1-4931-af31-cc455fc9dda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85016dff7e451ba86b63967221cd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:06Z,use_quota=True,user_id='b3c97a31c8614cc5bbf8386b148215f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e80d38-f5ad-44f4-a1df-e38efe4715f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e80d38-f5ad-44f4-a1df-e38efe4715f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2364ad79-8448-4f2f-9a85-1755e87a92b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2364ad79-8448-4f2f-9a85-1755e87a92b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6cd6d2-cff1-4931-af31-cc455fc9dda1', 'volume_name': 'volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e6439c-5fc1-4bc0-ba36-26da9fef366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e6439c-5fc1-4bc0-ba36-26da9fef366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8426a60f-5f19-4e71-9d4a-5545a733f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:05 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Volume 8f6cd6d2-cff1-4931-af31-cc455fc9dda1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1', 'volume_size': 1} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:05 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85 1073741824" returned: 0 in 0.623s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:05 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85 Apr 15 13:36:05 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:06 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847.16569d39-809f-4dcf-8a85-d8b50a498f8b" returned: 0 in 0.438s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-16569d39-809f-4dcf-8a85-d8b50a498f8b" released by "_delete_snapshot" :: held 1.998s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-53add8dd-d7c7-44bd-b3f7-48f127b8d847" released by "delete_snapshot" :: held 2.008s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:06 devstack cinder-volume[82595]: WARNING cinder.quota [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-168529483 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-168529483, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['06a6ec6d-6233-45ce-8b2a-014f79c32fff', '05f06f80-60c9-497d-9065-b6704c263512', 'eb27d0e4-198d-4384-b8e8-969a25c701ac', '585b0fcb-e487-429e-8072-0ced918f6250'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:06 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-81c6b196-6236-45a8-b74f-f8a90f63eae9 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot 29d789ca-e7d6-4354-a9c2-1905c23caed9: deleted successfully Apr 15 13:36:06 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85" returned: 0 in 0.443s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.541s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:06 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Cloning volume abc8d416-4146-49f2-bbaf-9e7c7998f171 to volume 67864033-f86a-4e55-969f-b8c671b12fe6 Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b239d9bd-50b4-4751-a72c-b3b5d4809791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98672b3-1187-45d1-ae26-0fb08e821c85', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7373dce-be00-4810-8b2e-7029992970b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:06 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Volume volume-b98672b3-1187-45d1-ae26-0fb08e821c85 (b98672b3-1187-45d1-ae26-0fb08e821c85): created successfully Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7373dce-be00-4810-8b2e-7029992970b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (66f45c7a-dbe5-41ac-89f7-8a5c840b3121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Creating offline snapshot 25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 of volume abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:36:06 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-7e2c600c-1fed-444d-a946-a951bfa53bf8 tempest-VolumesActionsTest-732107519 None] Created volume successfully. Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[936ea849-0b94-44cf-8406-8c9e6f1ec734]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-53add8dd-d7c7-44bd-b3f7-48f127b8d847" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-53add8dd-d7c7-44bd-b3f7-48f127b8d847" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:06 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 Apr 15 13:36:06 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b484e0-9578-43c0-8b3c-360f98ad814a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:06 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 Apr 15 13:36:06 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:06 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171" returned: 0 in 0.483s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:06 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 1G Apr 15 13:36:06 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:06 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847" returned: 0 in 0.474s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:06 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847 Apr 15 13:36:06 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Acquiring lock "cinder-b98672b3-1187-45d1-ae26-0fb08e821c85-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Lock "cinder-b98672b3-1187-45d1-ae26-0fb08e821c85-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Acquiring lock "cinder-quobyte-b98672b3-1187-45d1-ae26-0fb08e821c85" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Lock "cinder-quobyte-b98672b3-1187-45d1-ae26-0fb08e821c85" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[911c25e6-8698-4f4e-832e-10a66dcde172]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:07 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85 Apr 15 13:36:07 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:07 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 1G" returned: 0 in 0.529s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:07 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53add8dd-d7c7-44bd-b3f7-48f127b8d847" returned: 0 in 0.456s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-53add8dd-d7c7-44bd-b3f7-48f127b8d847" released by "delete_volume" :: held 0.963s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:07 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 Apr 15 13:36:07 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['6e00caf1-9a84-4fbe-a7a8-05e274ccea8a'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:07 devstack cinder-volume[82595]: WARNING cinder.db.sqlalchemy.api [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-168529483'] Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['c30819fe-082b-4685-9faa-76e7dad9d06d', '5a88f364-0de7-4e84-927f-91a5ead15dbd', '1d8d5e32-2490-4df1-8504-472f04189d4b', 'accbfbb3-1438-42b0-852f-44dbd625fe22'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:07 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:07 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:07 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85" returned: 0 in 0.548s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:07 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:07 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 is being set with open permissions: ugo+rw Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:07 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85 Apr 15 13:36:07 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:07 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 Apr 15 13:36:07 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:07 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.439s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:07 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:07 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-7d1fe4bc-68d4-4ddc-96f7-f3dfdfa3fc29 tempest-GroupSnapshotsTest-1876803718 None] Delete group completed successfully. Apr 15 13:36:08 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b98672b3-1187-45d1-ae26-0fb08e821c85" returned: 0 in 0.402s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Lock "cinder-quobyte-b98672b3-1187-45d1-ae26-0fb08e821c85" released by "delete_volume" :: held 0.970s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:08 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881" returned: 0 in 0.419s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Created reservations ['0f32ae09-f109-42f3-9372-c479d1d12653', '98b9555f-3039-46fc-86a7-537c0d59b855', 'fd49ec75-4ba4-4439-bb19-cc4f98570fed', '0bee5c71-e33f-4302-9c08-bc4a97f9af4a'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:08 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.info Apr 15 13:36:08 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:08 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:08 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:08 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.info" returned: 0 in 0.501s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:08 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.info is being set with open permissions: ugo+rw Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:08 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.465s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:08 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Deleted volume successfully. Apr 15 13:36:08 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.info Apr 15 13:36:08 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:08 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-385f14ad-6cfe-4332-adef-9395bb3b1369 tempest-GroupSnapshotsTest-1876803718 None] Group tempest-GroupSnapshotsTest-Group-1065011023: creating Apr 15 13:36:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-98c86d57-9be9-45b0-826a-01543cacdca2 tempest-VolumesActionsTest-417517530 None] Lock "cinder-b98672b3-1187-45d1-ae26-0fb08e821c85-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:08 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-385f14ad-6cfe-4332-adef-9395bb3b1369 tempest-GroupSnapshotsTest-1876803718 None] Group tempest-GroupSnapshotsTest-Group-1065011023: created successfully Apr 15 13:36:08 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-385f14ad-6cfe-4332-adef-9395bb3b1369 tempest-GroupSnapshotsTest-1876803718 None] Create group completed successfully. Apr 15 13:36:09 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.info" returned: 0 in 0.413s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Acquiring lock "cinder-quobyte-67864033-f86a-4e55-969f-b8c671b12fe6" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Lock "cinder-quobyte-67864033-f86a-4e55-969f-b8c671b12fe6" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] snapshot: 25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881, volume: 67864033-f86a-4e55-969f-b8c671b12fe6, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee120456-083c-410c-9429-6dbf69e553ed]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:09 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 Apr 15 13:36:09 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (6aff21e4-23bb-4b49-b9e2-8836bdff1be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a572fc-1dd6-4fa8-9957-583a4dfd4e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a572fc-1dd6-4fa8-9957-583a4dfd4e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-709007731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f762e52b-fdf2-4866-978a-c0481a3a1ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:10Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32b2477-7e00-4692-ae36-75f0d4952544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32b2477-7e00-4692-ae36-75f0d4952544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c0fdae-25c7-417d-8ee6-aaaa359c6637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c0fdae-25c7-417d-8ee6-aaaa359c6637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f762e52b-fdf2-4866-978a-c0481a3a1ef2', 'volume_name': 'volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0db8cd0-e0c8-4d38-8184-6a92a82ffa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0db8cd0-e0c8-4d38-8184-6a92a82ffa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb78433-1c84-4435-9e67-fa9760e9bcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:09 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Volume f762e52b-fdf2-4866-978a-c0481a3a1ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2', 'volume_size': 1} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:09 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881" returned: 0 in 0.479s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abc8d416-4146-49f2-bbaf-9e7c7998f171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0778b5-5d1c-4f93-a06a-c4acefd9b93c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:09 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 Apr 15 13:36:09 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Flow 'volume_create_manager' (1c57e275-8422-494a-b2e8-eb5fb0496a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8850e72e-f6a8-4a63-9e31-a58436359e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8850e72e-f6a8-4a63-9e31-a58436359e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-268753249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c2d2f9b-048e-4e3e-aaf0-4b017027b9ec,host='devstack@QuobyteHD#QuobyteHD',id=78bcfc7d-48b4-4391-aee4-5837669ff24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba64cc4461c4cdd967169860f6edced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:10Z,use_quota=True,user_id='69c532db8662409980f93aeecadedf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79f2f5d4-949a-4d13-8c35-10778a483bf8),volume_type_id=79f2f5d4-949a-4d13-8c35-10778a483bf8)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def0a0fe-6067-4e4c-8b56-a6d9438dfdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def0a0fe-6067-4e4c-8b56-a6d9438dfdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4a34b5-c367-47ab-bd95-301996ba0249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4a34b5-c367-47ab-bd95-301996ba0249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78bcfc7d-48b4-4391-aee4-5837669ff24b', 'volume_name': 'volume-78bcfc7d-48b4-4391-aee4-5837669ff24b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec314301-e405-41f0-8e48-0b6c0ab288b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec314301-e405-41f0-8e48-0b6c0ab288b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9886ad43-1a7f-46c8-b1da-72cb14de63fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:10 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Volume 78bcfc7d-48b4-4391-aee4-5837669ff24b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78bcfc7d-48b4-4391-aee4-5837669ff24b', 'volume_size': 1} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:10 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171" returned: 0 in 0.551s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:36:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:10 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 Apr 15 13:36:10 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:12 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6" returned: 0 in 2.027s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:12 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c55fde3-07d3-4745-9ad7-8fcffd54a20f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:12 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 Apr 15 13:36:12 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:12 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171" returned: 0 in 0.581s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:12 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:36:12 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Converted 1024.00 MB image at 504.92 MB/s Apr 15 13:36:12 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 is being set with open permissions: ugo+rw Apr 15 13:36:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:12 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 Apr 15 13:36:12 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:13 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6" returned: 0 in 0.416s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Lock "cinder-quobyte-67864033-f86a-4e55-969f-b8c671b12fe6" released by "_copy_volume_from_snapshot" :: held 4.108s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Acquiring lock "cinder-quobyte-25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Lock "cinder-quobyte-25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Deleting offline snapshot 25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 of volume abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] snapshot_file for this snap is: volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[50900a01-cf64-4ce4-9cd1-be72b4b68f7d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:13 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 Apr 15 13:36:13 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:13 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abc8d416-4146-49f2-bbaf-9e7c7998f171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cde4279-26b7-49f6-8bf3-2cdb1c7785a6]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:13 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 Apr 15 13:36:13 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:14 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171" returned: 0 in 0.465s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:14 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 Apr 15 13:36:14 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:14 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881" returned: 0 in 0.458s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:14 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881 Apr 15 13:36:14 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:15 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171.25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881" returned: 0 in 0.409s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Lock "cinder-quobyte-25bbd0cf-4a73-40b8-85f8-5e1fe9e3c881" released by "_delete_snapshot" :: held 1.845s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.967s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.478s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1876518624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6cd6d2-cff1-4931-af31-cc455fc9dda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85016dff7e451ba86b63967221cd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:06Z,use_quota=True,user_id='b3c97a31c8614cc5bbf8386b148215f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Creating volume 8f6cd6d2-cff1-4931-af31-cc455fc9dda1 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:15 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f8546b-d64f-462d-9c61-fe09c9a047d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67864033-f86a-4e55-969f-b8c671b12fe6', 'volume_size': 2, 'source_volid': 'abc8d416-4146-49f2-bbaf-9e7c7998f171', 'source_volstatus': 'available'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:15 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1 1073741824 Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b9b2d7-3488-43ca-aaeb-a78c5a51ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:15 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:15 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Volume volume-67864033-f86a-4e55-969f-b8c671b12fe6 (67864033-f86a-4e55-969f-b8c671b12fe6): created successfully Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b9b2d7-3488-43ca-aaeb-a78c5a51ff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Flow 'volume_create_manager' (0af361ad-a111-4cb4-b2cf-e173a8b106e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:15 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-1b5fb7c8-06f2-4a7e-8546-1fcb945342a4 tempest-VolumesCloneTest-311916453 None] Created volume successfully. Apr 15 13:36:15 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1 1073741824" returned: 0 in 0.485s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:15 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1 Apr 15 13:36:15 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:16 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1" returned: 0 in 0.411s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.505s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-709007731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f762e52b-fdf2-4866-978a-c0481a3a1ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:10Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Creating volume f762e52b-fdf2-4866-978a-c0481a3a1ef2 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:16 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8426a60f-5f19-4e71-9d4a-5545a733f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eed326b-dc8a-4afe-bd27-dd20c7da34fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:16 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2 1073741824 Apr 15 13:36:16 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:16 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Volume volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1 (8f6cd6d2-cff1-4931-af31-cc455fc9dda1): created successfully Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eed326b-dc8a-4afe-bd27-dd20c7da34fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Flow 'volume_create_manager' (3cc70288-2207-42c5-8362-92c6785965a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:16 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-58689fee-ab48-4d76-9725-54211f7a475b tempest-VolumesListAdminTestJSON-803892001 None] Created volume successfully. Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Acquiring lock "cinder-67864033-f86a-4e55-969f-b8c671b12fe6-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Lock "cinder-67864033-f86a-4e55-969f-b8c671b12fe6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Acquiring lock "cinder-quobyte-67864033-f86a-4e55-969f-b8c671b12fe6" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Lock "cinder-quobyte-67864033-f86a-4e55-969f-b8c671b12fe6" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae99379-39bd-449f-b6a7-5bb47049f2a5]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:16 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 Apr 15 13:36:16 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Flow 'volume_create_manager' (5c5005f0-0184-4621-bc48-1dbc89a502d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763ddda4-4864-40c9-8615-163adec8886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763ddda4-4864-40c9-8615-163adec8886c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-965946311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdaa94fb-a0f4-4f52-9e12-38a2a4044516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85016dff7e451ba86b63967221cd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:17Z,use_quota=True,user_id='b3c97a31c8614cc5bbf8386b148215f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5cc2c7-3bf9-41cd-a1a5-6fc1ee40434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5cc2c7-3bf9-41cd-a1a5-6fc1ee40434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d32982-1e62-4065-a8b3-d01c1fbc2ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:16 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d32982-1e62-4065-a8b3-d01c1fbc2ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdaa94fb-a0f4-4f52-9e12-38a2a4044516', 'volume_name': 'volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3b3760-dbcc-4a03-b168-a99485a27241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3b3760-dbcc-4a03-b168-a99485a27241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2bc428-7bfd-40f3-a96f-102dcaacb516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:16 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Volume bdaa94fb-a0f4-4f52-9e12-38a2a4044516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516', 'volume_size': 1} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2 1073741824" returned: 0 in 0.595s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:16 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2 Apr 15 13:36:16 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:17 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6" returned: 0 in 0.501s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:17 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6 Apr 15 13:36:17 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:17 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2" returned: 0 in 0.428s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.094s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c2d2f9b-048e-4e3e-aaf0-4b017027b9ec,created_at=2026-04-15T11:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-268753249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c2d2f9b-048e-4e3e-aaf0-4b017027b9ec,host='devstack@QuobyteHD#QuobyteHD',id=78bcfc7d-48b4-4391-aee4-5837669ff24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba64cc4461c4cdd967169860f6edced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:10Z,use_quota=True,user_id='69c532db8662409980f93aeecadedf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79f2f5d4-949a-4d13-8c35-10778a483bf8),volume_type_id=79f2f5d4-949a-4d13-8c35-10778a483bf8)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Creating volume 78bcfc7d-48b4-4391-aee4-5837669ff24b {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:17 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb78433-1c84-4435-9e67-fa9760e9bcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd7ceae-949c-432c-b0dd-e40a376a4161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:17 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b 1073741824 Apr 15 13:36:17 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:17 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Volume volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2 (f762e52b-fdf2-4866-978a-c0481a3a1ef2): created successfully Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd7ceae-949c-432c-b0dd-e40a376a4161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (6aff21e4-23bb-4b49-b9e2-8836bdff1be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:17 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-fe48b3b1-02d5-41da-b643-83778c172338 tempest-VolumesActionsTest-732107519 None] Created volume successfully. Apr 15 13:36:17 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-67864033-f86a-4e55-969f-b8c671b12fe6" returned: 0 in 0.414s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Lock "cinder-quobyte-67864033-f86a-4e55-969f-b8c671b12fe6" released by "delete_volume" :: held 0.940s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Created reservations ['cd82e68b-12d0-4976-b1c3-343681d9d09f', '2e86cd9d-4219-4d74-8837-27bdfd56944d', '586e4573-1814-4c9e-883a-5e23fee1b199', '3ae93c1c-5460-458e-8d6f-99b261b6aded'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:17 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:17 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:17 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b 1073741824" returned: 0 in 0.524s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:17 devstack sudo[87324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b Apr 15 13:36:17 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Acquiring lock "cinder-abc8d416-4146-49f2-bbaf-9e7c7998f171-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Lock "cinder-abc8d416-4146-49f2-bbaf-9e7c7998f171-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Acquiring lock "cinder-quobyte-abc8d416-4146-49f2-bbaf-9e7c7998f171" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Lock "cinder-quobyte-abc8d416-4146-49f2-bbaf-9e7c7998f171" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba76370d-51e2-4a80-b127-d09e84a55060]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:17 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 Apr 15 13:36:17 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Acquiring lock "cinder-f762e52b-fdf2-4866-978a-c0481a3a1ef2-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Lock "cinder-f762e52b-fdf2-4866-978a-c0481a3a1ef2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:18 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.558s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:18 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Deleted volume successfully. Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-db09fc89-1a70-4bcb-a197-2ff8558949e9 tempest-VolumesCloneTest-311916453 None] Lock "cinder-67864033-f86a-4e55-969f-b8c671b12fe6-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Acquiring lock "cinder-quobyte-f762e52b-fdf2-4866-978a-c0481a3a1ef2" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Lock "cinder-quobyte-f762e52b-fdf2-4866-978a-c0481a3a1ef2" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[df33f88d-725d-4ed9-88b9-1b4b08ea9453]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:18 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b" returned: 0 in 0.475s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:18 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2 Apr 15 13:36:18 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.488s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-965946311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdaa94fb-a0f4-4f52-9e12-38a2a4044516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85016dff7e451ba86b63967221cd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:17Z,use_quota=True,user_id='b3c97a31c8614cc5bbf8386b148215f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Creating volume bdaa94fb-a0f4-4f52-9e12-38a2a4044516 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:18 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9886ad43-1a7f-46c8-b1da-72cb14de63fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78bcfc7d-48b4-4391-aee4-5837669ff24b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:18 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516 1073741824 Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2434b021-2505-4e55-bfbd-5434f2d0c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:18 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:18 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Volume volume-78bcfc7d-48b4-4391-aee4-5837669ff24b (78bcfc7d-48b4-4391-aee4-5837669ff24b): created successfully Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2434b021-2505-4e55-bfbd-5434f2d0c05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Flow 'volume_create_manager' (1c57e275-8422-494a-b2e8-eb5fb0496a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:18 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-234179ff-6186-43b8-b0d6-8733d36344d9 tempest-GroupSnapshotsTest-1876803718 None] Created volume successfully. Apr 15 13:36:18 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171" returned: 0 in 0.535s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:18 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171 Apr 15 13:36:18 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:18 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2" returned: 0 in 0.495s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:18 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2 Apr 15 13:36:18 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:18 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516 1073741824" returned: 0 in 0.546s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:18 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516 Apr 15 13:36:18 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:18 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-abc8d416-4146-49f2-bbaf-9e7c7998f171" returned: 0 in 0.492s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Lock "cinder-quobyte-abc8d416-4146-49f2-bbaf-9e7c7998f171" released by "delete_volume" :: held 1.069s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Created reservations ['ca951a12-13f9-4439-b342-a2f74fd3c1e9', 'ecbe3829-0ad0-4c2f-8ba2-516ac8f583e2', '0d98e38a-b091-4940-a4a3-6744e955cc7b', '36672408-1902-4dad-b569-063e16dd743b'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:19 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:19 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Flow 'volume_create_manager' (82450705-d2b4-4e2f-937f-3adcb4ea35b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d780d4d2-4526-4413-bd56-964ec20f3dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d780d4d2-4526-4413-bd56-964ec20f3dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1530132734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c2d2f9b-048e-4e3e-aaf0-4b017027b9ec,host='devstack@QuobyteHD#QuobyteHD',id=5730e2f8-0dd0-4b71-85bc-9a3631d2780a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba64cc4461c4cdd967169860f6edced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:19Z,use_quota=True,user_id='69c532db8662409980f93aeecadedf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79f2f5d4-949a-4d13-8c35-10778a483bf8),volume_type_id=79f2f5d4-949a-4d13-8c35-10778a483bf8)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95041559-47c9-4d61-b43c-f6691b552ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95041559-47c9-4d61-b43c-f6691b552ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b00791f-793b-4ae3-9801-ee34725f813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:19 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b00791f-793b-4ae3-9801-ee34725f813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5730e2f8-0dd0-4b71-85bc-9a3631d2780a', 'volume_name': 'volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450c8836-8ce2-4bd3-b440-4571b239462c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450c8836-8ce2-4bd3-b440-4571b239462c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b4b52a-1a78-4d6c-80f8-06b066188068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:19 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Volume 5730e2f8-0dd0-4b71-85bc-9a3631d2780a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a', 'volume_size': 1} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f762e52b-fdf2-4866-978a-c0481a3a1ef2" returned: 0 in 0.536s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Lock "cinder-quobyte-f762e52b-fdf2-4866-978a-c0481a3a1ef2" released by "delete_volume" :: held 1.055s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Created reservations ['0d77e037-2364-4a90-88c7-d970917ed77d', '10bc73e7-e13d-4747-84b0-0d43aac0022b', 'ae158dfc-0daa-4a8d-83d2-d3d6a501da99', '8c83fc13-eb25-4715-aed2-eb17080cf7fa'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:19 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:19 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:19 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516" returned: 0 in 0.515s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.141s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c2d2f9b-048e-4e3e-aaf0-4b017027b9ec,created_at=2026-04-15T11:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1530132734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c2d2f9b-048e-4e3e-aaf0-4b017027b9ec,host='devstack@QuobyteHD#QuobyteHD',id=5730e2f8-0dd0-4b71-85bc-9a3631d2780a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba64cc4461c4cdd967169860f6edced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:19Z,use_quota=True,user_id='69c532db8662409980f93aeecadedf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79f2f5d4-949a-4d13-8c35-10778a483bf8),volume_type_id=79f2f5d4-949a-4d13-8c35-10778a483bf8)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Creating volume 5730e2f8-0dd0-4b71-85bc-9a3631d2780a {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:19 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2bc428-7bfd-40f3-a96f-102dcaacb516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:19 devstack sudo[87356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a 1073741824 Apr 15 13:36:19 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9fcffa-07e5-4156-82ed-e1e006a837b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:19 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Volume volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516 (bdaa94fb-a0f4-4f52-9e12-38a2a4044516): created successfully Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9fcffa-07e5-4156-82ed-e1e006a837b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Flow 'volume_create_manager' (5c5005f0-0184-4621-bc48-1dbc89a502d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:19 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-4fdebcac-6be4-4631-abc2-41965007348f tempest-VolumesListAdminTestJSON-803892001 None] Created volume successfully. Apr 15 13:36:19 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:19 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Deleted volume successfully. Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23c816e6-d1f8-48d9-b459-648dcf42cbed tempest-VolumesCloneTest-311916453 None] Lock "cinder-abc8d416-4146-49f2-bbaf-9e7c7998f171-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:19 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.411s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:19 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Deleted volume successfully. Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6815d569-4056-4668-9ea5-7e637adae35a tempest-VolumesActionsTest-417517530 None] Lock "cinder-f762e52b-fdf2-4866-978a-c0481a3a1ef2-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:19 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a 1073741824" returned: 0 in 0.511s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:19 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a Apr 15 13:36:19 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Flow 'volume_create_manager' (86ae1165-0200-45e4-bc7e-efc05b8d1b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8706c37-ee8e-4643-bdfe-772cd70c7bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8706c37-ee8e-4643-bdfe-772cd70c7bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2023c957a0334980a4beb16656cbaf41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:20Z,use_quota=True,user_id='72783297031d452d9e4b339125d2f3b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747efd7c-65d9-42a6-930d-9a783bbdb809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747efd7c-65d9-42a6-930d-9a783bbdb809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab1987c-d60a-4bab-afcc-dd3885421d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab1987c-d60a-4bab-afcc-dd3885421d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44', 'volume_name': 'volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0ad35d-369e-48e8-85c4-15a7fd1459f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0ad35d-369e-48e8-85c4-15a7fd1459f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9aff2f4-7607-4d1c-aceb-d6da69db18cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Volume e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44', 'volume_size': 1} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:20 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" returned: 0 in 0.564s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2023c957a0334980a4beb16656cbaf41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:20Z,use_quota=True,user_id='72783297031d452d9e4b339125d2f3b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Creating volume e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:20 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:20 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 1073741824 Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b4b52a-1a78-4d6c-80f8-06b066188068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11661f04-2fab-4de8-baa9-a1de88d170a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:20 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Volume volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a (5730e2f8-0dd0-4b71-85bc-9a3631d2780a): created successfully Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11661f04-2fab-4de8-baa9-a1de88d170a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Flow 'volume_create_manager' (82450705-d2b4-4e2f-937f-3adcb4ea35b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:20 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2587c97a-0b11-45c7-b4a7-3a152521d234 tempest-GroupSnapshotsTest-1876803718 None] Created volume successfully. Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (2022bf42-6a87-469b-9791-eb1720d0fa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd55d38-2924-4ed7-ae46-377ad681b0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd55d38-2924-4ed7-ae46-377ad681b0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-68758745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4968ca3-f517-4b8c-b07e-586164f66d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:21Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0229582-93bf-4129-b20c-ee6fdefae1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0229582-93bf-4129-b20c-ee6fdefae1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c345bd-32fc-4250-a364-f9839f76d616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c345bd-32fc-4250-a364-f9839f76d616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4968ca3-f517-4b8c-b07e-586164f66d19', 'volume_name': 'volume-b4968ca3-f517-4b8c-b07e-586164f66d19', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9e5e37-619e-47d0-8711-24974b04decd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9e5e37-619e-47d0-8711-24974b04decd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce58a64-620b-4b67-b01e-7070801bc582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:20 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Volume b4968ca3-f517-4b8c-b07e-586164f66d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4968ca3-f517-4b8c-b07e-586164f66d19', 'volume_size': 1} Apr 15 13:36:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:21 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 1073741824" returned: 0 in 0.553s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:21 devstack sudo[87371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 Apr 15 13:36:21 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2d97566c-ce18-4f3e-a824-62c789b14ee3 tempest-GroupSnapshotsTest-1876803718 None] Update group completed successfully. Apr 15 13:36:21 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44" returned: 0 in 0.540s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-68758745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4968ca3-f517-4b8c-b07e-586164f66d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:21Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Creating volume b4968ca3-f517-4b8c-b07e-586164f66d19 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:21 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9aff2f4-7607-4d1c-aceb-d6da69db18cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fef660-3912-49df-ab24-dec1d868cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:21 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19 1073741824 Apr 15 13:36:21 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Volume volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 (e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44): created successfully Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fef660-3912-49df-ab24-dec1d868cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Flow 'volume_create_manager' (86ae1165-0200-45e4-bc7e-efc05b8d1b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-3f2cc54a-7595-4fce-b9ab-ee0df8f5fca6 tempest-VolumesListAdminTestJSON-1454115154 None] Created volume successfully. Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Flow 'volume_create_manager' (a14a9afe-0bab-4d87-9915-8784498d4948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2848c256-1500-4b3d-aa7c-63c41a77c517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2848c256-1500-4b3d-aa7c-63c41a77c517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1211661880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2565c9c-56e4-4b0b-ae28-d7189801decc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c46c39de099482c841644422f9ad1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:22Z,use_quota=True,user_id='142702118cda4f05a769ae8b17f72896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b211c03-c303-4cb7-8f4d-af6af1fc34fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b211c03-c303-4cb7-8f4d-af6af1fc34fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec02f137-120c-494a-9db2-8961a83e1e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec02f137-120c-494a-9db2-8961a83e1e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2565c9c-56e4-4b0b-ae28-d7189801decc', 'volume_name': 'volume-b2565c9c-56e4-4b0b-ae28-d7189801decc', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564f0272-f0d1-4d21-8630-203917cff03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564f0272-f0d1-4d21-8630-203917cff03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf86a785-c707-4aa4-ae51-1d293f6895ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Volume b2565c9c-56e4-4b0b-ae28-d7189801decc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2565c9c-56e4-4b0b-ae28-d7189801decc', 'volume_size': 1} Apr 15 13:36:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Flow 'volume_create_manager' (25cb588d-5a25-4be3-a66a-596f98e5fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13444d39-e9e2-408e-a668-8a2240428006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13444d39-e9e2-408e-a668-8a2240428006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1849362916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19eeebd3-f412-4bf2-b3d2-e97c2366cac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c46c39de099482c841644422f9ad1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:22Z,use_quota=True,user_id='142702118cda4f05a769ae8b17f72896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4babbf25-6045-4f4e-ad05-30cd3791cfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4babbf25-6045-4f4e-ad05-30cd3791cfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb4d6d6-36b0-4ca2-ade2-12d07346021d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb4d6d6-36b0-4ca2-ade2-12d07346021d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19eeebd3-f412-4bf2-b3d2-e97c2366cac1', 'volume_name': 'volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101c56c0-9a26-401e-b814-c739d7cb45ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101c56c0-9a26-401e-b814-c739d7cb45ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5525b9-7c86-4cb2-8183-ec898424b90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Volume 19eeebd3-f412-4bf2-b3d2-e97c2366cac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1', 'volume_size': 1} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:22 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19 1073741824" returned: 0 in 0.574s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:22 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19 Apr 15 13:36:22 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Flow 'volume_create_manager' (4f1914b5-7cc6-4398-ba2d-fd8c92044e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf79c47-08c4-422e-a710-4f682a3849d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf79c47-08c4-422e-a710-4f682a3849d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1176449016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da9e327-3e3d-4735-97c6-9563a2c79f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c46c39de099482c841644422f9ad1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:22Z,use_quota=True,user_id='142702118cda4f05a769ae8b17f72896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41c9a4e-0fae-4169-8081-2d2dc51da8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41c9a4e-0fae-4169-8081-2d2dc51da8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826cba54-94f3-4928-8309-20bdedb41a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826cba54-94f3-4928-8309-20bdedb41a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da9e327-3e3d-4735-97c6-9563a2c79f1e', 'volume_name': 'volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc21885-36c9-4620-b8a8-57cc05a1dc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc21885-36c9-4620-b8a8-57cc05a1dc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4dbcb0-f698-4ce1-ae50-ba4f02091128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Volume 9da9e327-3e3d-4735-97c6-9563a2c79f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e', 'volume_size': 1} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Flow 'volume_create_manager' (2bf48d7d-d751-40b2-a63e-b07686cb46fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8507aa0f-3a11-4b3b-a59a-12d1a5f4f585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Acquiring lock "cinder-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8507aa0f-3a11-4b3b-a59a-12d1a5f4f585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-777286377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e66d325-cb89-47cb-9d7b-df68dada26e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c46c39de099482c841644422f9ad1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:23Z,use_quota=True,user_id='142702118cda4f05a769ae8b17f72896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fd75b1-6c69-41a5-8041-d3f728031c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fd75b1-6c69-41a5-8041-d3f728031c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4c56f2-483a-4e28-af28-c688be081dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4c56f2-483a-4e28-af28-c688be081dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e66d325-cb89-47cb-9d7b-df68dada26e9', 'volume_name': 'volume-9e66d325-cb89-47cb-9d7b-df68dada26e9', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bdb714-758b-40bf-a4ac-84280238d477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bdb714-758b-40bf-a4ac-84280238d477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8514f954-7855-400e-9ae9-dca51c26a1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Volume 9e66d325-cb89-47cb-9d7b-df68dada26e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e66d325-cb89-47cb-9d7b-df68dada26e9', 'volume_size': 1} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Lock "cinder-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:22 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19" returned: 0 in 0.483s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1211661880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2565c9c-56e4-4b0b-ae28-d7189801decc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c46c39de099482c841644422f9ad1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:22Z,use_quota=True,user_id='142702118cda4f05a769ae8b17f72896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Creating volume b2565c9c-56e4-4b0b-ae28-d7189801decc {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:22 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce58a64-620b-4b67-b01e-7070801bc582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4968ca3-f517-4b8c-b07e-586164f66d19', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e703bb-e411-4290-babe-b198b50b3c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc 1073741824 Apr 15 13:36:22 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Acquiring lock "cinder-quobyte-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "cinder-bdaa94fb-a0f4-4f52-9e12-38a2a4044516-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:22 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b3cd31b4-18d7-426f-8247-edc0ed9e51a4 tempest-GroupSnapshotsTest-1876803718 None] Update group completed successfully. Apr 15 13:36:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Volume volume-b4968ca3-f517-4b8c-b07e-586164f66d19 (b4968ca3-f517-4b8c-b07e-586164f66d19): created successfully Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e703bb-e411-4290-babe-b198b50b3c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (2022bf42-6a87-469b-9791-eb1720d0fa1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Flow 'volume_create_manager' (8b8f287e-d6ec-4ec8-a43f-e704e7f6a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcabbfed-a538-4127-94a8-19eca62d2c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Lock "cinder-quobyte-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44" acquired by "delete_volume" :: waited 0.077s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-bdaa94fb-a0f4-4f52-9e12-38a2a4044516-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:22 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e45001aa-d6fb-4055-be09-16cf1264340a tempest-VolumesActionsTest-732107519 None] Created volume successfully. Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48efd47-10e8-4c5f-bb70-b0725d5d378b]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcabbfed-a538-4127-94a8-19eca62d2c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791647025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d62c3d-868a-4d96-95ba-cedbb03a0c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c46c39de099482c841644422f9ad1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:23Z,use_quota=True,user_id='142702118cda4f05a769ae8b17f72896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01747d90-d79c-434f-a693-5e3dd10ff739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01747d90-d79c-434f-a693-5e3dd10ff739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d9f84e-20f8-4491-afb6-9ece1a15eb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d9f84e-20f8-4491-afb6-9ece1a15eb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d62c3d-868a-4d96-95ba-cedbb03a0c17', 'volume_name': 'volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b2ed4a-6560-47c0-b2a9-a8591cdf22b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b2ed4a-6560-47c0-b2a9-a8591cdf22b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e24f265-3cbd-4459-8f5b-a351c855dfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Volume 27d62c3d-868a-4d96-95ba-cedbb03a0c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17', 'volume_size': 1} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "cinder-quobyte-bdaa94fb-a0f4-4f52-9e12-38a2a4044516" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:23 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 Apr 15 13:36:23 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-quobyte-bdaa94fb-a0f4-4f52-9e12-38a2a4044516" acquired by "delete_volume" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[0455a300-e397-420f-be1c-3cc14238e547]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:23 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516 Apr 15 13:36:23 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:23 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc 1073741824" returned: 0 in 0.537s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:23 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc Apr 15 13:36:23 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:23 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44" returned: 0 in 0.535s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:23 devstack sudo[87399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44 Apr 15 13:36:23 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:23 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516" returned: 0 in 0.526s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:23 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516 Apr 15 13:36:23 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:23 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:23 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-ad56bdca-0d8b-44e6-9fd7-b3e5c6163aa1 tempest-GroupSnapshotsTest-1876803718 None] Update group completed successfully. Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc" returned: 0 in 0.458s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1849362916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19eeebd3-f412-4bf2-b3d2-e97c2366cac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c46c39de099482c841644422f9ad1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:22Z,use_quota=True,user_id='142702118cda4f05a769ae8b17f72896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Creating volume 19eeebd3-f412-4bf2-b3d2-e97c2366cac1 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:23 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf86a785-c707-4aa4-ae51-1d293f6895ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2565c9c-56e4-4b0b-ae28-d7189801decc', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66737304-386f-4927-820e-4071c27a4550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:23 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Volume volume-b2565c9c-56e4-4b0b-ae28-d7189801decc (b2565c9c-56e4-4b0b-ae28-d7189801decc): created successfully Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66737304-386f-4927-820e-4071c27a4550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Flow 'volume_create_manager' (a14a9afe-0bab-4d87-9915-8784498d4948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:23 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1 1073741824 Apr 15 13:36:23 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:23 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e19a0f90-95ef-4014-a58f-8f85024dded0 tempest-CreateVolumesFromImageTest-449678054 None] Created volume successfully. Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Acquiring lock "cinder-b4968ca3-f517-4b8c-b07e-586164f66d19-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Lock "cinder-b4968ca3-f517-4b8c-b07e-586164f66d19-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Acquiring lock "cinder-quobyte-b4968ca3-f517-4b8c-b07e-586164f66d19" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:24 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44" returned: 0 in 0.552s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Lock "cinder-quobyte-b4968ca3-f517-4b8c-b07e-586164f66d19" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Lock "cinder-quobyte-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44" released by "delete_volume" :: held 1.130s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[6206f997-1da5-4d90-9144-960bd9c8dd10]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Created reservations ['2838ac94-8a9e-4208-97fb-1e93ccae9b93', 'fbcb11fe-0dc9-4d22-b708-0c764724af77', '8ff70e51-7e21-4af2-9bfe-d890bf081c88', '4bdba694-7346-453f-a798-d05c306ef1c2'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:24 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-bdaa94fb-a0f4-4f52-9e12-38a2a4044516" returned: 0 in 0.540s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-quobyte-bdaa94fb-a0f4-4f52-9e12-38a2a4044516" released by "delete_volume" :: held 1.090s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:24 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19 Apr 15 13:36:24 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Created reservations ['7bfea66e-be49-429b-82cb-388b827b91ee', '5cba99f4-6897-4f35-8b8f-103a7921e041', 'f05b7320-1c63-42e4-b2e9-a9f01666aef6', 'a5777827-4b78-4899-8d34-7532cc023860'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:24 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:24 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:24 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:24 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:24 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1 1073741824" returned: 0 in 0.624s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:24 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1 Apr 15 13:36:24 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:24 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19" returned: 0 in 0.510s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:24 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19 Apr 15 13:36:24 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:24 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:24 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Deleted volume successfully. Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d24e3001-91f3-4b7f-95df-0bc011b21be1 tempest-VolumesListAdminTestJSON-1454115154 None] Lock "cinder-e20b8e7c-9d1a-4b4e-be8b-d0a4373efe44-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:24 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.480s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:24 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Deleted volume successfully. Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2421e916-f765-4405-92d6-3f0c225adfec tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-bdaa94fb-a0f4-4f52-9e12-38a2a4044516-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:24 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1" returned: 0 in 0.435s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.481s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1176449016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da9e327-3e3d-4735-97c6-9563a2c79f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c46c39de099482c841644422f9ad1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:22Z,use_quota=True,user_id='142702118cda4f05a769ae8b17f72896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Creating volume 9da9e327-3e3d-4735-97c6-9563a2c79f1e {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:24 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5525b9-7c86-4cb2-8183-ec898424b90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac3dd3e-5c18-4553-9407-af31adee91ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:24 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Volume volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1 (19eeebd3-f412-4bf2-b3d2-e97c2366cac1): created successfully Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac3dd3e-5c18-4553-9407-af31adee91ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Flow 'volume_create_manager' (25cb588d-5a25-4be3-a66a-596f98e5fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:24 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e 1073741824 Apr 15 13:36:24 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:24 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e779ea06-d1a9-4a85-9aae-b3810c93b638 tempest-CreateVolumesFromImageTest-449678054 None] Created volume successfully. Apr 15 13:36:24 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-ea71d644-cb0b-4831-96a9-be919e9956fa tempest-GroupSnapshotsTest-1876803718 None] Update group completed successfully. Apr 15 13:36:25 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b4968ca3-f517-4b8c-b07e-586164f66d19" returned: 0 in 0.495s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Lock "cinder-quobyte-b4968ca3-f517-4b8c-b07e-586164f66d19" released by "delete_volume" :: held 1.028s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "cinder-8f6cd6d2-cff1-4931-af31-cc455fc9dda1-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-8f6cd6d2-cff1-4931-af31-cc455fc9dda1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Created reservations ['04f68da3-b721-4ef4-9420-d45cd45224b6', '52a56834-c763-4dbc-905c-f0490b152685', '5226e256-246b-4c65-9280-e2b27b275a5b', 'e8a4ab33-3860-40c1-95a6-01ba06d3d105'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "cinder-quobyte-8f6cd6d2-cff1-4931-af31-cc455fc9dda1" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-quobyte-8f6cd6d2-cff1-4931-af31-cc455fc9dda1" acquired by "delete_volume" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[724cdfce-ead7-4d4a-90ed-cebf07c50fca]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:25 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:25 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:25 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1 Apr 15 13:36:25 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:25 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e 1073741824" returned: 0 in 0.601s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:25 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e Apr 15 13:36:25 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:25 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1" returned: 0 in 0.488s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:25 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.465s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:25 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Deleted volume successfully. Apr 15 13:36:25 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1 Apr 15 13:36:25 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c04eb55e-ac33-43ab-a175-189e4daa4b6d tempest-VolumesActionsTest-417517530 None] Lock "cinder-b4968ca3-f517-4b8c-b07e-586164f66d19-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:25 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e" returned: 0 in 0.446s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.294s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-777286377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e66d325-cb89-47cb-9d7b-df68dada26e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c46c39de099482c841644422f9ad1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:23Z,use_quota=True,user_id='142702118cda4f05a769ae8b17f72896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Creating volume 9e66d325-cb89-47cb-9d7b-df68dada26e9 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:25 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4dbcb0-f698-4ce1-ae50-ba4f02091128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43c1293-faa7-44a2-af17-27f81f6191dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:26 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Volume volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e (9da9e327-3e3d-4735-97c6-9563a2c79f1e): created successfully Apr 15 13:36:26 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9 1073741824 Apr 15 13:36:26 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43c1293-faa7-44a2-af17-27f81f6191dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Flow 'volume_create_manager' (4f1914b5-7cc6-4398-ba2d-fd8c92044e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:26 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-114dde9d-dd11-40d3-a3f3-99746c7eb9d6 tempest-CreateVolumesFromImageTest-449678054 None] Created volume successfully. Apr 15 13:36:26 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8f6cd6d2-cff1-4931-af31-cc455fc9dda1" returned: 0 in 0.473s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-quobyte-8f6cd6d2-cff1-4931-af31-cc455fc9dda1" released by "delete_volume" :: held 0.985s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Created reservations ['76fc0028-da8a-4ef5-8d56-861a0cca81c9', 'f7f728f9-18dc-4aa3-b496-b54533ae5a15', 'd8137495-43e1-46a1-8752-d1191c3d01f2', '4d5b6dac-59d0-4f9c-9d80-52058ecb1e4a'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:26 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] GroupSnapshot dafe587a-901b-4a4c-81c1-3eb93d51254b: creating. Apr 15 13:36:26 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:26 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Group snapshot dafe587a-901b-4a4c-81c1-3eb93d51254b: creating. {{(pid=82595) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (2a804f89-be40-4e69-b040-11165a3243a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c58aee9-cf52-4ebc-b0fc-28ee34a50ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c58aee9-cf52-4ebc-b0fc-28ee34a50ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2023418108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:27Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29db602e-7eb5-406c-af9e-103563249895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29db602e-7eb5-406c-af9e-103563249895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8e69fd-20d6-4ca8-a220-21debbc38b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:26 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8e69fd-20d6-4ca8-a220-21debbc38b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f', 'volume_name': 'volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24e86e17-7138-40c0-b31d-d92a9a74f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24e86e17-7138-40c0-b31d-d92a9a74f542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba7d74f-a774-4596-8925-b1fdb49290ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:26 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Volume d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f', 'volume_size': 1} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9 1073741824" returned: 0 in 0.644s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:26 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9 Apr 15 13:36:26 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:26 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.528s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:26 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Deleted volume successfully. Apr 15 13:36:26 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2d168744-4f4e-415b-8891-fae2a0312d6f tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-8f6cd6d2-cff1-4931-af31-cc455fc9dda1-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:27 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9" returned: 0 in 0.419s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.094s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791647025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d62c3d-868a-4d96-95ba-cedbb03a0c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c46c39de099482c841644422f9ad1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:23Z,use_quota=True,user_id='142702118cda4f05a769ae8b17f72896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Creating volume 27d62c3d-868a-4d96-95ba-cedbb03a0c17 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:27 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8514f954-7855-400e-9ae9-dca51c26a1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e66d325-cb89-47cb-9d7b-df68dada26e9', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47f6941-d520-4cb4-8ba9-2905e8cab819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:27 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17 1073741824 Apr 15 13:36:27 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:27 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Volume volume-9e66d325-cb89-47cb-9d7b-df68dada26e9 (9e66d325-cb89-47cb-9d7b-df68dada26e9): created successfully Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47f6941-d520-4cb4-8ba9-2905e8cab819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Flow 'volume_create_manager' (2bf48d7d-d751-40b2-a63e-b07686cb46fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:27 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-77e29a7d-58a6-4e72-a656-05f5b768a8af tempest-CreateVolumesFromImageTest-449678054 None] Created volume successfully. Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "cinder-70ada0c1-bc7c-47b4-bc28-694e1a72b051-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-70ada0c1-bc7c-47b4-bc28-694e1a72b051-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "cinder-quobyte-70ada0c1-bc7c-47b4-bc28-694e1a72b051" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-quobyte-70ada0c1-bc7c-47b4-bc28-694e1a72b051" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[6694b57a-7cfc-48b9-9429-598ee33497e8]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:27 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051 Apr 15 13:36:27 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:27 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17 1073741824" returned: 0 in 0.570s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:27 devstack sudo[87466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17 Apr 15 13:36:27 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:27 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051" returned: 0 in 0.509s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:27 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051 Apr 15 13:36:27 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:28 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17" returned: 0 in 0.407s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.777s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Creating offline snapshot 9740a80e-2cba-4afc-bb31-9692708b6995 of volume 78bcfc7d-48b4-4391-aee4-5837669ff24b {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e24f265-3cbd-4459-8f5b-a351c855dfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cc9e28-f71d-40f3-a070-7b372f5ad129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3eb69c-fc0f-4f28-bef3-ec569dbd4d70]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:28 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Volume volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17 (27d62c3d-868a-4d96-95ba-cedbb03a0c17): created successfully Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cc9e28-f71d-40f3-a070-7b372f5ad129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Flow 'volume_create_manager' (8b8f287e-d6ec-4ec8-a43f-e704e7f6a915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:28 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a967cd4a-77b9-4e39-bcd1-bb20b673d8a5 tempest-CreateVolumesFromImageTest-449678054 None] Created volume successfully. Apr 15 13:36:28 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b Apr 15 13:36:28 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "cinder-27d62c3d-868a-4d96-95ba-cedbb03a0c17-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:28 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-70ada0c1-bc7c-47b4-bc28-694e1a72b051" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-quobyte-70ada0c1-bc7c-47b4-bc28-694e1a72b051" released by "delete_volume" :: held 1.009s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-27d62c3d-868a-4d96-95ba-cedbb03a0c17-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "cinder-quobyte-27d62c3d-868a-4d96-95ba-cedbb03a0c17" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-quobyte-27d62c3d-868a-4d96-95ba-cedbb03a0c17" acquired by "delete_volume" :: waited 0.030s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Created reservations ['5d672176-0b31-4d1d-8cd6-b970dca3cb6e', '456b30f0-b2b8-4ce4-a8a6-978d4f49ccd3', '7f06fc79-5fdc-45c0-9e48-3b15e5078af2', '2526dd9b-e6c1-4c17-908e-95336b178c92'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e817e5-fb88-4da9-a9af-d25f28c86047]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:28 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:28 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:28 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17 Apr 15 13:36:28 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:28 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b" returned: 0 in 0.540s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:28 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 1G Apr 15 13:36:28 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:28 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.421s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:28 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Deleted volume successfully. Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9f3184ce-27e3-4cee-8cf2-6bfbf80f0429 tempest-VolumesListAdminTestJSON-803892001 None] Lock "cinder-70ada0c1-bc7c-47b4-bc28-694e1a72b051-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:28 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17" returned: 0 in 0.531s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:29 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17 Apr 15 13:36:29 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:29 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 1G" returned: 0 in 0.489s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78bcfc7d-48b4-4391-aee4-5837669ff24b -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:29 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78bcfc7d-48b4-4391-aee4-5837669ff24b -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 Apr 15 13:36:29 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:29 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-27d62c3d-868a-4d96-95ba-cedbb03a0c17" returned: 0 in 0.414s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-quobyte-27d62c3d-868a-4d96-95ba-cedbb03a0c17" released by "delete_volume" :: held 0.970s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Created reservations ['c3ac5d5c-bfe3-4945-8758-1d9e136c6634', '037401c9-b89b-4c4f-98d9-dfc281328996', '669a3cae-eb5a-4b67-b410-444098f3aff9', '6afefb11-fab8-4fe8-8cc5-e47b1907e1fc'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:29 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:29 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:29 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78bcfc7d-48b4-4391-aee4-5837669ff24b -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:29 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:36:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:29 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 Apr 15 13:36:29 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:30 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.505s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:30 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Deleted volume successfully. Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9d2ea4fc-889d-48fc-9a1e-816b56050a90 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-27d62c3d-868a-4d96-95ba-cedbb03a0c17-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:30 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995" returned: 0 in 0.454s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:30 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.info Apr 15 13:36:30 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "cinder-9e66d325-cb89-47cb-9d7b-df68dada26e9-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:30 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.info" returned: 0 in 0.479s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:30 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-9e66d325-cb89-47cb-9d7b-df68dada26e9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:30 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.info Apr 15 13:36:30 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "cinder-quobyte-9e66d325-cb89-47cb-9d7b-df68dada26e9" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-quobyte-9e66d325-cb89-47cb-9d7b-df68dada26e9" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5301e984-2773-4ea3-9333-e36130ac34a6]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:30 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9 Apr 15 13:36:30 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:31 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.info" returned: 0 in 0.510s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.013s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Creating offline snapshot 9ece4aad-3bde-4692-8369-bc82d7a798d9 of volume 5730e2f8-0dd0-4b71-85bc-9a3631d2780a {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a50c35-fcd4-46ef-a272-fd01e5ebcb8e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:31 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9" returned: 0 in 0.536s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:31 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9 Apr 15 13:36:31 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:31 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a Apr 15 13:36:31 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:31 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9e66d325-cb89-47cb-9d7b-df68dada26e9" returned: 0 in 0.496s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-quobyte-9e66d325-cb89-47cb-9d7b-df68dada26e9" released by "delete_volume" :: held 1.057s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:31 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" returned: 0 in 0.617s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Created reservations ['81dc2d14-9bcc-4aa6-87ea-f9de88d14066', '6886a0fa-0ce1-4ef9-98b8-2e6f23831c8e', 'b508a100-41a5-4050-a166-dd719f9e594a', 'd5998985-e70b-4d1b-a7a1-32af1639981d'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:31 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 1G Apr 15 13:36:31 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:31 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:31 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Flow 'volume_create_manager' (a8861787-3cb4-4be7-ba24-4cc1b6adcc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b54a29a-fb53-4908-a90c-5a778181488e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b54a29a-fb53-4908-a90c-5a778181488e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-540418405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de348ba9-8d08-4eb2-867c-9a1ed9d170a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590b322898404ec399dfbab5d6232127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:32Z,use_quota=True,user_id='1a4647acf5b34ec88b9322fcbabd97c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:32 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aaeb115-9777-4026-bfc8-68aa487ea897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aaeb115-9777-4026-bfc8-68aa487ea897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87dd3fe9-0d75-4e88-bbb7-64cea7b7f94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.image.glance [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Creating Keystone auth plugin from conf {{(pid=82595) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 1G" returned: 0 in 0.555s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:32 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 Apr 15 13:36:32 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:32 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.547s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:32 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Deleted volume successfully. Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59bc378a-fb62-4135-90ea-71879a0bd554 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-9e66d325-cb89-47cb-9d7b-df68dada26e9-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87dd3fe9-0d75-4e88-bbb7-64cea7b7f94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de348ba9-8d08-4eb2-867c-9a1ed9d170a6', 'volume_name': 'volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470ca56b-00ba-463e-98f2-9b88dc752401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470ca56b-00ba-463e-98f2-9b88dc752401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ed217e-db76-4e12-929f-61575138bf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:32 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Volume de348ba9-8d08-4eb2-867c-9a1ed9d170a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Trying to clone de348ba9-8d08-4eb2-867c-9a1ed9d170a6 from image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]). {{(pid=82595) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 13:36:32 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Image download 20.69 MB at 20.69 MB/s Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[167a22b6-6f0d-4797-8058-315fa17384bb]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:32 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD Apr 15 13:36:32 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "cinder-9da9e327-3e3d-4735-97c6-9563a2c79f1e-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-9da9e327-3e3d-4735-97c6-9563a2c79f1e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:32 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9" returned: 0 in 0.535s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:32 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:32 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 Apr 15 13:36:32 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "cinder-quobyte-9da9e327-3e3d-4735-97c6-9563a2c79f1e" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-quobyte-9da9e327-3e3d-4735-97c6-9563a2c79f1e" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[2638dfb9-2e1c-4d70-94eb-67bac414ed6d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:32 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e Apr 15 13:36:32 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:33 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD" returned: 0 in 0.527s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Temporary image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 is fetched for user 1a4647acf5b34ec88b9322fcbabd97c8. {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a803c337-aee9-4040-95ae-c92664448f4f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:33 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9" returned: 0 in 0.463s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:33 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.info Apr 15 13:36:33 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:33 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD Apr 15 13:36:33 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:33 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e" returned: 0 in 0.504s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_service.periodic_task [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82595) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:33 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e Apr 15 13:36:33 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:33 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:33 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:33 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:33 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.info" returned: 0 in 0.458s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:33 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:33 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.info Apr 15 13:36:33 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:33 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9da9e327-3e3d-4735-97c6-9563a2c79f1e" returned: 0 in 0.422s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-quobyte-9da9e327-3e3d-4735-97c6-9563a2c79f1e" released by "delete_volume" :: held 0.951s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:33 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.452s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Created reservations ['83cd04b8-e071-4034-9ab4-ad6b420d1fd7', '46101b89-d554-4f24-a3b4-2ccf64605533', '6ecc1a1b-20be-48bd-a652-22477814a66c', 'afbda6ee-8e37-4011-94f6-4866ce051403'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:33 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:33 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "cinder-19eeebd3-f412-4bf2-b3d2-e97c2366cac1-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-19eeebd3-f412-4bf2-b3d2-e97c2366cac1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "cinder-quobyte-19eeebd3-f412-4bf2-b3d2-e97c2366cac1" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-quobyte-19eeebd3-f412-4bf2-b3d2-e97c2366cac1" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b60591-bdd6-45ae-935b-07b3b63d86d8]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:34 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1 Apr 15 13:36:34 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:34 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.info" returned: 0 in 0.455s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.141s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.617s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2023418108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:27Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Creating volume d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:34 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:34 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f 1073741824 Apr 15 13:36:34 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:34 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-950331f9-7f40-44bd-b5a0-a5381d3bd957 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot dafe587a-901b-4a4c-81c1-3eb93d51254b: created successfully Apr 15 13:36:34 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.467s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:34 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Deleted volume successfully. Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5e55b52e-4a0b-48a2-9c0d-9ddae27d82ea tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-9da9e327-3e3d-4735-97c6-9563a2c79f1e-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:34 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1" returned: 0 in 0.543s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:34 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1 Apr 15 13:36:34 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:34 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot dafe587a-901b-4a4c-81c1-3eb93d51254b: deleting Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot dafe587a-901b-4a4c-81c1-3eb93d51254b: deleting {{(pid=82595) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-78bcfc7d-48b4-4391-aee4-5837669ff24b" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-78bcfc7d-48b4-4391-aee4-5837669ff24b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-9740a80e-2cba-4afc-bb31-9692708b6995" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-9740a80e-2cba-4afc-bb31-9692708b6995" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Deleting offline snapshot 9740a80e-2cba-4afc-bb31-9692708b6995 of volume 78bcfc7d-48b4-4391-aee4-5837669ff24b {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] snapshot_file for this snap is: volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b65081-0ccf-4478-8962-3bb06224b92e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:34 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f 1073741824" returned: 0 in 0.547s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:34 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 Apr 15 13:36:34 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:34 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f Apr 15 13:36:34 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:35 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-19eeebd3-f412-4bf2-b3d2-e97c2366cac1" returned: 0 in 0.509s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-quobyte-19eeebd3-f412-4bf2-b3d2-e97c2366cac1" released by "delete_volume" :: held 1.076s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Created reservations ['1c6e3825-3384-4de2-9cb0-38a7d6f913c4', '7d7d9936-3eb3-42b3-8d9d-d58070147687', '75ee8f2e-ab8b-4bd5-9837-300307d95170', '056f6801-28b7-4ebc-b060-7d46adeebba0'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:35 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:35 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:35 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f" returned: 0 in 0.465s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-540418405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de348ba9-8d08-4eb2-867c-9a1ed9d170a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590b322898404ec399dfbab5d6232127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:32Z,use_quota=True,user_id='1a4647acf5b34ec88b9322fcbabd97c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Creating volume de348ba9-8d08-4eb2-867c-9a1ed9d170a6 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:35 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:35 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995" returned: 0 in 0.561s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78bcfc7d-48b4-4391-aee4-5837669ff24b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:36:35 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 1073741824 Apr 15 13:36:35 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba7d74f-a774-4596-8925-b1fdb49290ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207abf55-275d-4f27-aec6-ce87d6108bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed1114d-9782-472f-ac67-3b65ca089a34]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:35 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Volume volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f (d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f): created successfully Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207abf55-275d-4f27-aec6-ce87d6108bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (2a804f89-be40-4e69-b040-11165a3243a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:35 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b6825cc6-1cb9-4c9f-b0c9-dcf2236c51d7 tempest-VolumesActionsTest-732107519 None] Created volume successfully. Apr 15 13:36:35 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b Apr 15 13:36:35 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:35 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.450s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:35 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Deleted volume successfully. Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-00d0d2e1-775a-4a44-956f-1b2c6aae06c3 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-19eeebd3-f412-4bf2-b3d2-e97c2366cac1-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:35 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 1073741824" returned: 0 in 0.498s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:35 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:35 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 Apr 15 13:36:35 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:35 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 Apr 15 13:36:35 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "cinder-b2565c9c-56e4-4b0b-ae28-d7189801decc-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-b2565c9c-56e4-4b0b-ae28-d7189801decc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Acquiring lock "cinder-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Lock "cinder-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "cinder-quobyte-b2565c9c-56e4-4b0b-ae28-d7189801decc" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-quobyte-b2565c9c-56e4-4b0b-ae28-d7189801decc" acquired by "delete_volume" :: waited 0.035s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Acquiring lock "cinder-quobyte-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7747ec81-527b-449a-a9e7-dd96ed72d906]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:36 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6" returned: 0 in 0.482s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Lock "cinder-quobyte-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f" acquired by "delete_volume" :: waited 0.021s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa28b6c3-885d-4b03-ba73-1699b0cb97a1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Attempting download of 082fb149-5a21-4aac-9c2e-bdc7043feaf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}])) to volume de348ba9-8d08-4eb2-867c-9a1ed9d170a6. {{(pid=82595) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 13:36:36 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995" returned: 0 in 0.512s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:36 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc Apr 15 13:36:36 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73615d7-2809-4c0b-b571-76e41d8d6a2b]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_4urxl_3o {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:36 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995 Apr 15 13:36:36 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:36 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f Apr 15 13:36:36 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:36 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_4urxl_3o Apr 15 13:36:36 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:36 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f" returned: 0 in 0.469s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:36 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b.9740a80e-2cba-4afc-bb31-9692708b6995" returned: 0 in 0.455s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:36 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f Apr 15 13:36:36 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:36 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc" returned: 0 in 0.541s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-9740a80e-2cba-4afc-bb31-9692708b6995" released by "_delete_snapshot" :: held 2.105s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:36 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc Apr 15 13:36:36 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-78bcfc7d-48b4-4391-aee4-5837669ff24b" released by "delete_snapshot" :: held 2.117s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:36 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-9ece4aad-3bde-4692-8369-bc82d7a798d9" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_4urxl_3o" returned: 0 in 0.503s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_4urxl_3o {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-9ece4aad-3bde-4692-8369-bc82d7a798d9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Deleting offline snapshot 9ece4aad-3bde-4692-8369-bc82d7a798d9 of volume 5730e2f8-0dd0-4b71-85bc-9a3631d2780a {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] snapshot_file for this snap is: volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e2a9de-da88-4c12-ba56-f17081afe278]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:36 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_4urxl_3o Apr 15 13:36:36 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:37 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 Apr 15 13:36:37 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:37 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f" returned: 0 in 0.454s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Lock "cinder-quobyte-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f" released by "delete_volume" :: held 0.947s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:37 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b2565c9c-56e4-4b0b-ae28-d7189801decc" returned: 0 in 0.502s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-quobyte-b2565c9c-56e4-4b0b-ae28-d7189801decc" released by "delete_volume" :: held 1.073s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Created reservations ['8e0f6e6c-6f93-4eaf-8037-9a28a5b12f36', '12bbcec9-09e2-4c4e-80ee-6a1a0b266fc5', 'b44f6329-97ff-498a-9e08-e5dc161ffdf0', 'bbea3582-528e-4c1f-8a3b-8bd05fbd2de5'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:37 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_4urxl_3o" returned: 1 in 0.497s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_4urxl_3o' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b690b33-d018-420c-a9cc-9ec5747135f6]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:37 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9" returned: 0 in 0.521s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:36:37 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:37 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Created reservations ['932333a5-f097-4aed-8126-bd68030a45b3', '7071fe1c-7a4b-4bc1-b03e-b8df6803c8a0', '84ecb2bd-d87e-4647-a49a-5f7d65e54887', '9c04219e-679c-4e99-8a57-e4b916ff3743'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:37 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD Apr 15 13:36:37 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1c530c-db43-496f-86fa-80c764276508]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:37 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a Apr 15 13:36:37 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:37 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:37 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:37 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.421s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:37 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Deleted volume successfully. Apr 15 13:36:37 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] 082fb149-5a21-4aac-9c2e-bdc7043feaf2 was qcow2, converting to raw {{(pid=82595) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d2a72c2-6bd5-4a09-84eb-112dc23b7847 tempest-VolumesActionsTest-417517530 None] Lock "cinder-d2ef4cd4-8940-4d2b-8cf2-6e3c0798e67f-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:37 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 Apr 15 13:36:37 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:37 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" returned: 0 in 0.504s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:38 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 Apr 15 13:36:38 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:38 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:38 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Deleted volume successfully. Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b29a9156-394c-43f2-94e1-ade7ebd40ae8 tempest-CreateVolumesFromImageTest-449678054 None] Lock "cinder-b2565c9c-56e4-4b0b-ae28-d7189801decc-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:38 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9" returned: 0 in 0.566s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:38 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9 Apr 15 13:36:38 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (04de2519-c8ff-4ab2-a565-67128f9be9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0fad03-b96c-49f6-80ab-96b9913c7a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0fad03-b96c-49f6-80ab-96b9913c7a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-166590652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bcb1b8-cee3-4654-8d00-fed0d2630d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:39Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb09a719-e117-4d4d-9789-3429684bace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb09a719-e117-4d4d-9789-3429684bace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89a4192-a422-46ec-9a4a-266652803139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89a4192-a422-46ec-9a4a-266652803139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6bcb1b8-cee3-4654-8d00-fed0d2630d5f', 'volume_name': 'volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dbb756-5011-4ece-a3ca-f5ecd9af8e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dbb756-5011-4ece-a3ca-f5ecd9af8e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:38 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ada2a8-bdc9-40a6-9223-33ffa40b28f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:38 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Volume c6bcb1b8-cee3-4654-8d00-fed0d2630d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f', 'volume_size': 1} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-166590652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bcb1b8-cee3-4654-8d00-fed0d2630d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b430023dae6438295e1e146c9ac40d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:39Z,use_quota=True,user_id='14e86c67269a4212900bfc535282a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Creating volume c6bcb1b8-cee3-4654-8d00-fed0d2630d5f {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:38 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6" returned: 0 in 1.016s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_mlapu094devstack@QuobyteHD, size 112.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:36:38 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Converted 112.00 MB image at 109.96 MB/s Apr 15 13:36:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:38 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f 1073741824 Apr 15 13:36:38 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:38 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 1G Apr 15 13:36:38 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:39 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a.9ece4aad-3bde-4692-8369-bc82d7a798d9" returned: 0 in 0.490s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-9ece4aad-3bde-4692-8369-bc82d7a798d9" released by "_delete_snapshot" :: held 2.154s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" released by "delete_snapshot" :: held 2.180s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:39 devstack cinder-volume[82595]: WARNING cinder.quota [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-453146651 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-453146651, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:36:39 devstack cinder-volume[82595]: WARNING cinder.quota [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-453146651 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-453146651, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['535d2b96-faad-4598-a897-9a6362fa685c', 'f49bba5a-c068-4e22-a182-e2c674839b81', '04bf8dbf-a884-409f-9b15-de4a31b3a995', 'ed16cbcd-9601-4227-87c8-41adc5a0ef17'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['eadf2ed2-b21e-41d0-b787-4c6f22fd5f82', '404c6766-938c-4979-9f71-bd4330750961', '7d768be0-928d-4317-b25b-546cd5a1b44b', '5bef0696-9345-466a-b797-088f11793a03'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:39 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-11420183-94ce-47f0-8fdc-714183d730b8 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot dafe587a-901b-4a4c-81c1-3eb93d51254b: deleted successfully Apr 15 13:36:39 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 1G" returned: 0 in 0.531s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6d9ab0-29af-40c9-b906-a4e35d6dfcce]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:39 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f 1073741824" returned: 0 in 0.605s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:39 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 Apr 15 13:36:39 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:39 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f Apr 15 13:36:39 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:39 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f" returned: 0 in 0.442s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ada2a8-bdc9-40a6-9223-33ffa40b28f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:39 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc120d6a-dfce-4e20-b7d4-994bab114172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6" returned: 0 in 0.521s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:39 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Volume volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f (c6bcb1b8-cee3-4654-8d00-fed0d2630d5f): created successfully Apr 15 13:36:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc120d6a-dfce-4e20-b7d4-994bab114172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Flow 'volume_create_manager' (04de2519-c8ff-4ab2-a565-67128f9be9d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:40 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-4153859a-6235-4763-8016-b5095936c06b tempest-VolumesActionsTest-732107519 None] Created volume successfully. Apr 15 13:36:40 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 Apr 15 13:36:40 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (2eec5f6f-158d-44da-9b3f-8485d4e2839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc8bd5f-9f85-4bf1-a83a-fc1884fcabc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc8bd5f-9f85-4bf1-a83a-fc1884fcabc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-120874889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d042a9-b02e-4ce8-b9cb-c3de9bb60f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:40Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107bb928-5b5f-4b00-9dd8-52e807da63f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107bb928-5b5f-4b00-9dd8-52e807da63f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9ec014-0d99-4508-b6ff-d4c25acaf40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9ec014-0d99-4508-b6ff-d4c25acaf40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d042a9-b02e-4ce8-b9cb-c3de9bb60f52', 'volume_name': 'volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b16dc90-775f-4cbc-ba08-2028398bab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b16dc90-775f-4cbc-ba08-2028398bab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56ab34f-9669-432e-89b2-4b08be8c860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:40 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume 60d042a9-b02e-4ce8-b9cb-c3de9bb60f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52', 'volume_size': 1} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-120874889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d042a9-b02e-4ce8-b9cb-c3de9bb60f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:40Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Creating volume 60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:40 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:40 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:40 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 1073741824 Apr 15 13:36:40 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6" returned: 1 in 0.561s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Downloaded image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}])) to volume de348ba9-8d08-4eb2-867c-9a1ed9d170a6 successfully. {{(pid=82595) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Temporary image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 for user 1a4647acf5b34ec88b9322fcbabd97c8 is deleted. {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Marking volume de348ba9-8d08-4eb2-867c-9a1ed9d170a6 as bootable. {{(pid=82595) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Copying metadata from image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 to de348ba9-8d08-4eb2-867c-9a1ed9d170a6. {{(pid=82595) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Creating volume glance metadata for volume de348ba9-8d08-4eb2-867c-9a1ed9d170a6 backed by image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82595) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" acquired by "delete_volume" :: waited 0.022s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8411dd-0a37-4bbb-8e42-c70fd43b2186]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ed217e-db76-4e12-929f-61575138bf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67036972-018c-48b4-a481-4260ca4f3bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:40 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Volume volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 (de348ba9-8d08-4eb2-867c-9a1ed9d170a6): created successfully Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67036972-018c-48b4-a481-4260ca4f3bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:40 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Flow 'volume_create_manager' (a8861787-3cb4-4be7-ba24-4cc1b6adcc2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:40 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0e8a915f-d619-429b-a767-70131b31030c tempest-VolumesImageMetadata-769054259 None] Created volume successfully. Apr 15 13:36:40 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a Apr 15 13:36:40 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:41 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 1073741824" returned: 0 in 0.517s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:41 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 Apr 15 13:36:41 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:41 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" returned: 0 in 0.566s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:41 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a Apr 15 13:36:41 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Acquiring lock "cinder-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Lock "cinder-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Acquiring lock "cinder-quobyte-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Lock "cinder-quobyte-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a4ce2b-144a-4aca-8543-ec7ed7b366d1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:41 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52" returned: 0 in 0.456s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:41 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f Apr 15 13:36:41 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56ab34f-9669-432e-89b2-4b08be8c860d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00d6b0a-cd70-4dbe-aad9-ea57c18b5536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:41 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 (60d042a9-b02e-4ce8-b9cb-c3de9bb60f52): created successfully Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00d6b0a-cd70-4dbe-aad9-ea57c18b5536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (2eec5f6f-158d-44da-9b3f-8485d4e2839c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:41 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-8b109d7d-ed6f-4a5b-b609-f734de27178a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created volume successfully. Apr 15 13:36:41 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" returned: 0 in 0.489s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-5730e2f8-0dd0-4b71-85bc-9a3631d2780a" released by "delete_volume" :: held 1.083s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-78bcfc7d-48b4-4391-aee4-5837669ff24b" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-78bcfc7d-48b4-4391-aee4-5837669ff24b" acquired by "delete_volume" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ee44dc-cb62-4eeb-84c5-908f59cc177d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:41 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b Apr 15 13:36:41 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:41 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f" returned: 0 in 0.501s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:41 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f Apr 15 13:36:41 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Acquiring lock "cinder-de348ba9-8d08-4eb2-867c-9a1ed9d170a6-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Lock "cinder-de348ba9-8d08-4eb2-867c-9a1ed9d170a6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Acquiring lock "cinder-quobyte-de348ba9-8d08-4eb2-867c-9a1ed9d170a6" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Lock "cinder-quobyte-de348ba9-8d08-4eb2-867c-9a1ed9d170a6" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:42 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b" returned: 0 in 0.507s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1edd20-11c0-4442-9b44-0ad268ec90cd]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:42 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b Apr 15 13:36:42 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:42 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 Apr 15 13:36:42 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:42 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f" returned: 0 in 0.451s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Lock "cinder-quobyte-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f" released by "delete_volume" :: held 0.987s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Created reservations ['f0fad099-f63e-4bb1-ae97-5b1ba2fbbc54', '479eaab4-d730-4db4-a164-922151a3befc', 'f61ba4a3-7582-4eb6-be50-6ccd777846eb', 'c6b42ced-ad9f-4884-a351-209d339f7f4f'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:42 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:42 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:42 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78bcfc7d-48b4-4391-aee4-5837669ff24b" returned: 0 in 0.509s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-78bcfc7d-48b4-4391-aee4-5837669ff24b" released by "delete_volume" :: held 1.045s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:42 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6" returned: 0 in 0.554s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['80689daa-962a-4be8-9c19-edb5d14d5eea'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:42 devstack cinder-volume[82595]: WARNING cinder.quota [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-453146651 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-453146651, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['aa84a704-34fa-44e0-99dd-90b29c012857', '9390f368-93cc-41eb-a630-78a53f42f99c', '20ba1b32-42fa-4126-9ef9-2f4e8f9794e6', '139d6524-7576-4f80-b8cc-886675f0f8d5'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:42 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 Apr 15 13:36:42 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (19ec99d6-484f-4e10-b6fb-0dd4ebfb95a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bade400d-49ce-49f0-a5b0-33940d2d68f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bade400d-49ce-49f0-a5b0-33940d2d68f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716546386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b04667-1801-4b8a-8536-df9dfc331cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:43Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0976d2b5-3b16-4ee2-9834-b0c484dceb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0976d2b5-3b16-4ee2-9834-b0c484dceb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6ea63f-2c4b-4c6c-966b-6c85e11895a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6ea63f-2c4b-4c6c-966b-6c85e11895a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b04667-1801-4b8a-8536-df9dfc331cda', 'volume_name': 'volume-b3b04667-1801-4b8a-8536-df9dfc331cda', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ff898e-4bdb-42ca-af86-e992bad6985e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ff898e-4bdb-42ca-af86-e992bad6985e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f31b42d-002b-43c8-8bc4-d5ca0e2127ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:42 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume b3b04667-1801-4b8a-8536-df9dfc331cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b04667-1801-4b8a-8536-df9dfc331cda', 'volume_size': 1} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716546386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b04667-1801-4b8a-8536-df9dfc331cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:43Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Creating volume b3b04667-1801-4b8a-8536-df9dfc331cda {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:42 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:43 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda 1073741824 Apr 15 13:36:43 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['48a964bd-ef67-4930-9ea5-2b231879c2e7', 'e29bc8ec-d01f-4719-8498-c2b4b005383d', '91ef3c67-0e87-4854-84ac-777a80656038', 'a176cb92-7846-45a9-a89b-cc8bdb2becb2'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:43 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.566s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (1959e2fa-2e1b-4a99-a3d1-eacaa20c9a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb421c3-1d2a-44f5-ba0b-d0f3cecb7920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb421c3-1d2a-44f5-ba0b-d0f3cecb7920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766763454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2570b2-bba6-461f-84bb-d628a07857b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:43Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd22f05-0efa-4b2a-b53a-c59a3bffc3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd22f05-0efa-4b2a-b53a-c59a3bffc3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292ef7d7-ee4d-4763-8bf9-1c4be1c5b0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292ef7d7-ee4d-4763-8bf9-1c4be1c5b0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2570b2-bba6-461f-84bb-d628a07857b1', 'volume_name': 'volume-8b2570b2-bba6-461f-84bb-d628a07857b1', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2dc27b-88bb-4669-84f1-f4fce14b575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2dc27b-88bb-4669-84f1-f4fce14b575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1c4ea6-e4e6-41b4-bcfe-136e248c8897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume 8b2570b2-bba6-461f-84bb-d628a07857b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2570b2-bba6-461f-84bb-d628a07857b1', 'volume_size': 1} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:43 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Deleted volume successfully. Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-ba0bf37a-3351-4e32-ba8a-3e020362057c tempest-VolumesActionsTest-732107519 None] Lock "cinder-c6bcb1b8-cee3-4654-8d00-fed0d2630d5f-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:43 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:43 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (6282ac94-ec7f-400e-916c-0998c1533591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d996e87e-a34f-41e9-a957-d58a70c997a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d996e87e-a34f-41e9-a957-d58a70c997a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-809543618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:43Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d055b4ba-ca95-4c6e-8877-7e59fad00635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d055b4ba-ca95-4c6e-8877-7e59fad00635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6a577b-2153-4831-bbaf-b9a8e58f186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6a577b-2153-4831-bbaf-b9a8e58f186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94', 'volume_name': 'volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b33a79-5273-4bf1-956f-ac47143b2864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b33a79-5273-4bf1-956f-ac47143b2864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0db88c1-6ed7-4e0c-a17e-9ce4a47f8c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume 7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94', 'volume_size': 1} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:43 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6" returned: 1 in 0.838s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (2cf93726-b608-4b51-8f3f-88b663fd91c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85620290-77d9-4697-81bd-dd1e99b9f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6 Apr 15 13:36:43 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85620290-77d9-4697-81bd-dd1e99b9f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1874520012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef06055-42e0-4aa7-b98f-80bbf453b70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:44Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c9441d-48cb-4d11-8860-4dc18da4710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c9441d-48cb-4d11-8860-4dc18da4710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5dfc18-4571-4c7b-88d2-942dfb9d1cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5dfc18-4571-4c7b-88d2-942dfb9d1cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef06055-42e0-4aa7-b98f-80bbf453b70d', 'volume_name': 'volume-fef06055-42e0-4aa7-b98f-80bbf453b70d', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bbfbd0-44e2-4146-8dff-d661df9b8e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bbfbd0-44e2-4146-8dff-d661df9b8e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4026c4-c92c-4b78-8714-942e0c64cd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:43 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume fef06055-42e0-4aa7-b98f-80bbf453b70d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef06055-42e0-4aa7-b98f-80bbf453b70d', 'volume_size': 1} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:43 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.710s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:43 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:43 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (01fae34b-0683-4fed-8172-4e5d1467f474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c98fb4b-2137-4321-ac90-8aaa7eb05565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c98fb4b-2137-4321-ac90-8aaa7eb05565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558210740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7af090-2c52-446c-8ccc-f53561f4618c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:44Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9670f7-b71a-4464-9716-20d4539e4ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9670f7-b71a-4464-9716-20d4539e4ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99692d6-c793-4339-9aa5-b7591b0777f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99692d6-c793-4339-9aa5-b7591b0777f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf7af090-2c52-446c-8ccc-f53561f4618c', 'volume_name': 'volume-cf7af090-2c52-446c-8ccc-f53561f4618c', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c20b779-552d-4488-8579-57030221bb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c20b779-552d-4488-8579-57030221bb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c82285d-a493-411e-a568-05d88286c7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:44 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume cf7af090-2c52-446c-8ccc-f53561f4618c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf7af090-2c52-446c-8ccc-f53561f4618c', 'volume_size': 1} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda 1073741824" returned: 0 in 1.127s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:44 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-829b13df-6e39-4bc1-a1d3-ba4749a512fd tempest-GroupSnapshotsTest-1876803718 None] Delete group completed successfully. Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:44 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda Apr 15 13:36:44 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:44 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-26105c5d-321f-4f0e-b0d0-987fd75d68b1 tempest-GroupSnapshotsTest-1876803718 None] Group tempest-GroupSnapshotsTest-Group-316766049: creating Apr 15 13:36:44 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-26105c5d-321f-4f0e-b0d0-987fd75d68b1 tempest-GroupSnapshotsTest-1876803718 None] Group tempest-GroupSnapshotsTest-Group-316766049: created successfully Apr 15 13:36:44 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-26105c5d-321f-4f0e-b0d0-987fd75d68b1 tempest-GroupSnapshotsTest-1876803718 None] Create group completed successfully. Apr 15 13:36:44 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-de348ba9-8d08-4eb2-867c-9a1ed9d170a6" returned: 0 in 0.713s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Lock "cinder-quobyte-de348ba9-8d08-4eb2-867c-9a1ed9d170a6" released by "delete_volume" :: held 2.163s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Created reservations ['e0c5626f-e494-4f76-9040-2cea9b284c5d', '73462a8a-a0f3-4847-a8d6-0c787a68c15b', '7e2183f2-dcb0-43fe-8a11-19d6e53d00a1', 'c4713413-8ec5-4d2e-82ad-c1bcf1aac4ae'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:44 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:44 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:44 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda" returned: 0 in 0.584s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766763454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2570b2-bba6-461f-84bb-d628a07857b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:43Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Creating volume 8b2570b2-bba6-461f-84bb-d628a07857b1 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:44 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f31b42d-002b-43c8-8bc4-d5ca0e2127ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b04667-1801-4b8a-8536-df9dfc331cda', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96b9a58-1c59-4f15-8cfc-31c682372b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:44 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume volume-b3b04667-1801-4b8a-8536-df9dfc331cda (b3b04667-1801-4b8a-8536-df9dfc331cda): created successfully Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96b9a58-1c59-4f15-8cfc-31c682372b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (19ec99d6-484f-4e10-b6fb-0dd4ebfb95a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:44 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1 1073741824 Apr 15 13:36:44 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:44 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-ab45835f-e5bf-4d72-80a6-48764e569c46 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created volume successfully. Apr 15 13:36:44 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:44 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Deleted volume successfully. Apr 15 13:36:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9816f041-a325-493c-97f9-d3e0eaf44006 tempest-VolumesImageMetadata-769054259 None] Lock "cinder-de348ba9-8d08-4eb2-867c-9a1ed9d170a6-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:45 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1 1073741824" returned: 0 in 0.666s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:45 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1 Apr 15 13:36:45 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Flow 'volume_create_manager' (034e1ebd-2f68-4ea7-8483-25d85e802e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21d71bc-48f6-4b53-96df-c5a5550a018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21d71bc-48f6-4b53-96df-c5a5550a018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1658769388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eacb1e8-f7ec-4d80-a6f3-268666be5df1,host='devstack@QuobyteHD#QuobyteHD',id=a7431445-f92e-4cac-933c-b5f5c176b439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba64cc4461c4cdd967169860f6edced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:46Z,use_quota=True,user_id='69c532db8662409980f93aeecadedf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b14cac6-380e-4e1b-ad1b-3ac822713e17),volume_type_id=6b14cac6-380e-4e1b-ad1b-3ac822713e17)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c766786-a199-4fab-ac9f-670c13cb3e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c766786-a199-4fab-ac9f-670c13cb3e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bc5f46-03d4-45a0-9cc9-5f3f1ba8d9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bc5f46-03d4-45a0-9cc9-5f3f1ba8d9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7431445-f92e-4cac-933c-b5f5c176b439', 'volume_name': 'volume-a7431445-f92e-4cac-933c-b5f5c176b439', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b9c2f5-4ad6-4e5b-a5a6-4c4e2b9f9bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b9c2f5-4ad6-4e5b-a5a6-4c4e2b9f9bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82408a6-71f5-4f3f-8e26-9a0aae6905df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:45 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Volume a7431445-f92e-4cac-933c-b5f5c176b439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7431445-f92e-4cac-933c-b5f5c176b439', 'volume_size': 1} Apr 15 13:36:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:46 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1" returned: 0 in 0.631s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.552s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-809543618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:43Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Creating volume 7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:46 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1c4ea6-e4e6-41b4-bcfe-136e248c8897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2570b2-bba6-461f-84bb-d628a07857b1', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0eb5ed9-2670-4301-a113-c6d1b38da9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:46 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 1073741824 Apr 15 13:36:46 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:46 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume volume-8b2570b2-bba6-461f-84bb-d628a07857b1 (8b2570b2-bba6-461f-84bb-d628a07857b1): created successfully Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0eb5ed9-2670-4301-a113-c6d1b38da9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (1959e2fa-2e1b-4a99-a3d1-eacaa20c9a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:46 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-fcf89413-ca12-4034-bd39-13e8fa5540ef tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created volume successfully. Apr 15 13:36:46 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 1073741824" returned: 0 in 0.632s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:46 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 Apr 15 13:36:46 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:47 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94" returned: 0 in 0.495s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.494s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1874520012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef06055-42e0-4aa7-b98f-80bbf453b70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:44Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Creating volume fef06055-42e0-4aa7-b98f-80bbf453b70d {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:47 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0db88c1-6ed7-4e0c-a17e-9ce4a47f8c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2561f7-900b-4f16-8a9d-bf4c71e9bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:47 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d 1073741824 Apr 15 13:36:47 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:47 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 (7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94): created successfully Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2561f7-900b-4f16-8a9d-bf4c71e9bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (6282ac94-ec7f-400e-916c-0998c1533591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:47 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2c9610eb-ec7e-470f-bf77-1b9a8b9c5d95 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created volume successfully. Apr 15 13:36:47 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d 1073741824" returned: 0 in 0.620s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:47 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d Apr 15 13:36:47 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Flow 'volume_create_manager' (b954f561-ccfc-4adb-9f79-0f8e5974e016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1105d4b-3868-459d-9900-d78619fdd8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1105d4b-3868-459d-9900-d78619fdd8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-541409047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f916995-a2f2-460c-89db-d17bf8cbb635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d95529bf694e37a3006fc4d3b00d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:48Z,use_quota=True,user_id='ebd30f8ea6f3454baca28e6dd773162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f084532-f60a-4a46-8a40-09a7303b2589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f084532-f60a-4a46-8a40-09a7303b2589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918b91fb-dc8e-43d4-893c-11caa058063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918b91fb-dc8e-43d4-893c-11caa058063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f916995-a2f2-460c-89db-d17bf8cbb635', 'volume_name': 'volume-2f916995-a2f2-460c-89db-d17bf8cbb635', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a18400-56cd-46a0-9723-7b0a2282ea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a18400-56cd-46a0-9723-7b0a2282ea41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb18a868-dc61-443d-ac0e-4b80f33a6270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:48 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Volume 2f916995-a2f2-460c-89db-d17bf8cbb635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f916995-a2f2-460c-89db-d17bf8cbb635', 'volume_size': 1} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:48 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d" returned: 0 in 0.492s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.256s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558210740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7af090-2c52-446c-8ccc-f53561f4618c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae7deb892e940bd9d66c799c4e6a906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:44Z,use_quota=True,user_id='452be46db4544a16af78663ca9a91c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Creating volume cf7af090-2c52-446c-8ccc-f53561f4618c {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:48 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4026c4-c92c-4b78-8714-942e0c64cd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef06055-42e0-4aa7-b98f-80bbf453b70d', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8f9019-2df9-47b7-bf0b-34c6a09d73d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:48 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c 1073741824 Apr 15 13:36:48 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:48 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume volume-fef06055-42e0-4aa7-b98f-80bbf453b70d (fef06055-42e0-4aa7-b98f-80bbf453b70d): created successfully Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8f9019-2df9-47b7-bf0b-34c6a09d73d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (2cf93726-b608-4b51-8f3f-88b663fd91c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:48 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-06f5ec70-6376-4495-8d24-4f781d01197d tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created volume successfully. Apr 15 13:36:48 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c 1073741824" returned: 0 in 0.510s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:48 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c Apr 15 13:36:48 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:49 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c" returned: 0 in 0.477s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.581s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3eacb1e8-f7ec-4d80-a6f3-268666be5df1,created_at=2026-04-15T11:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1658769388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eacb1e8-f7ec-4d80-a6f3-268666be5df1,host='devstack@QuobyteHD#QuobyteHD',id=a7431445-f92e-4cac-933c-b5f5c176b439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba64cc4461c4cdd967169860f6edced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:46Z,use_quota=True,user_id='69c532db8662409980f93aeecadedf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b14cac6-380e-4e1b-ad1b-3ac822713e17),volume_type_id=6b14cac6-380e-4e1b-ad1b-3ac822713e17)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Creating volume a7431445-f92e-4cac-933c-b5f5c176b439 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:49 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c82285d-a493-411e-a568-05d88286c7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf7af090-2c52-446c-8ccc-f53561f4618c', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3bbc479-13e4-4349-8650-cf3ad5d7354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:49 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 1073741824 Apr 15 13:36:49 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:49 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Volume volume-cf7af090-2c52-446c-8ccc-f53561f4618c (cf7af090-2c52-446c-8ccc-f53561f4618c): created successfully Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3bbc479-13e4-4349-8650-cf3ad5d7354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Flow 'volume_create_manager' (01fae34b-0683-4fed-8172-4e5d1467f474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:49 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-d33c74be-33e0-4f58-b33e-861630cb0611 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created volume successfully. Apr 15 13:36:49 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 1073741824" returned: 0 in 0.524s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:49 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 Apr 15 13:36:49 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:50 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.097s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-541409047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f916995-a2f2-460c-89db-d17bf8cbb635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d95529bf694e37a3006fc4d3b00d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:48Z,use_quota=True,user_id='ebd30f8ea6f3454baca28e6dd773162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Creating volume 2f916995-a2f2-460c-89db-d17bf8cbb635 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:50 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82408a6-71f5-4f3f-8e26-9a0aae6905df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7431445-f92e-4cac-933c-b5f5c176b439', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:50 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635 1073741824 Apr 15 13:36:50 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ff0c19-02dd-4634-9914-1efba6aa5c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:50 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Volume volume-a7431445-f92e-4cac-933c-b5f5c176b439 (a7431445-f92e-4cac-933c-b5f5c176b439): created successfully Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ff0c19-02dd-4634-9914-1efba6aa5c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Flow 'volume_create_manager' (034e1ebd-2f68-4ea7-8483-25d85e802e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:50 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-1500fbdb-e47b-4fbd-81bb-984aaf3aa8cc tempest-GroupSnapshotsTest-1876803718 None] Created volume successfully. Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-cf7af090-2c52-446c-8ccc-f53561f4618c-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-cf7af090-2c52-446c-8ccc-f53561f4618c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-quobyte-cf7af090-2c52-446c-8ccc-f53561f4618c" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-cf7af090-2c52-446c-8ccc-f53561f4618c" acquired by "delete_volume" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d06516-3090-42dc-b7b5-8f28137f27d0]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:50 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c Apr 15 13:36:50 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:51 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635 1073741824" returned: 0 in 0.583s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:51 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635 Apr 15 13:36:51 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:51 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c" returned: 0 in 0.578s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:51 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c Apr 15 13:36:51 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:51 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] GroupSnapshot 9baa7e08-d842-41a9-a3b2-08bd9089309d: creating. Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Group snapshot 9baa7e08-d842-41a9-a3b2-08bd9089309d: creating. {{(pid=82595) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:51 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635" returned: 0 in 0.581s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:51 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.354s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb18a868-dc61-443d-ac0e-4b80f33a6270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f916995-a2f2-460c-89db-d17bf8cbb635', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c552661-5ba0-4f13-9501-edd69e07f0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf7af090-2c52-446c-8ccc-f53561f4618c" returned: 0 in 0.493s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Creating offline snapshot 25066eaa-b476-4341-978e-d9da6a7a7cbe of volume a7431445-f92e-4cac-933c-b5f5c176b439 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-cf7af090-2c52-446c-8ccc-f53561f4618c" released by "delete_volume" :: held 1.106s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[808b448f-464e-496a-900b-1f129a7d65b4]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:51 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Volume volume-2f916995-a2f2-460c-89db-d17bf8cbb635 (2f916995-a2f2-460c-89db-d17bf8cbb635): created successfully Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c552661-5ba0-4f13-9501-edd69e07f0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Flow 'volume_create_manager' (b954f561-ccfc-4adb-9f79-0f8e5974e016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:51 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-1ff6d95e-a8c8-4ef1-b538-dd6c28770d44 tempest-VolumesTransfersV355Test-716614204 None] Created volume successfully. Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created reservations ['d268f06b-b755-449a-afc5-39f810761da6', '51d4e882-cfa8-4d9c-af0c-1ac4c938491d', 'd1467b30-6b25-4138-846e-dd4a7a4f1d9d', 'd9ba69d2-16e5-4115-af88-aac2fa724319'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:51 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 Apr 15 13:36:51 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:51 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:51 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Flow 'volume_create_manager' (4bfeb360-5dd5-4661-8d78-116da6323ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0466030a-428c-4af7-8c09-9e9605b29efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0466030a-428c-4af7-8c09-9e9605b29efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1757331459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731bf985-565f-4a77-b782-1cf77d55a83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eed4b894a64145928f966810b80876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:52Z,use_quota=True,user_id='03b7adcd25874c2fa38ae0243502fac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a90eb36-4b65-4063-921a-eadccfd2d4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a90eb36-4b65-4063-921a-eadccfd2d4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47dfdbf4-19a3-4c71-bd4b-19491570a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47dfdbf4-19a3-4c71-bd4b-19491570a503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731bf985-565f-4a77-b782-1cf77d55a83c', 'volume_name': 'volume-731bf985-565f-4a77-b782-1cf77d55a83c', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2ab55b-dee1-44f6-ace5-f4d01563d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2ab55b-dee1-44f6-ace5-f4d01563d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b31475-8540-424b-88a9-2276664e9889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:51 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Volume 731bf985-565f-4a77-b782-1cf77d55a83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731bf985-565f-4a77-b782-1cf77d55a83c', 'volume_size': 1} Apr 15 13:36:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:52 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:52 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe 1G Apr 15 13:36:52 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:52 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.412s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:52 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Deleted volume successfully. Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9c50f517-23c0-4a15-a2b3-be1a07ef2f6e tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-cf7af090-2c52-446c-8ccc-f53561f4618c-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-fef06055-42e0-4aa7-b98f-80bbf453b70d-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-fef06055-42e0-4aa7-b98f-80bbf453b70d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:52 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe 1G" returned: 0 in 0.550s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7431445-f92e-4cac-933c-b5f5c176b439 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-quobyte-fef06055-42e0-4aa7-b98f-80bbf453b70d" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-fef06055-42e0-4aa7-b98f-80bbf453b70d" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:52 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7431445-f92e-4cac-933c-b5f5c176b439 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe Apr 15 13:36:52 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[0320fc29-53a0-445d-8ab5-39f7013860bc]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:52 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d Apr 15 13:36:52 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:52 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9efd8f27-0f0c-4e9c-a7f1-e226d9a23391 tempest-VolumesTransfersV355Test-242900447 None] Transfer volume completed successfully. Apr 15 13:36:53 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7431445-f92e-4cac-933c-b5f5c176b439 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:53 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:53 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe Apr 15 13:36:53 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:53 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:53 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d Apr 15 13:36:53 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Acquiring lock "cinder-2f916995-a2f2-460c-89db-d17bf8cbb635-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:53 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fef06055-42e0-4aa7-b98f-80bbf453b70d" returned: 0 in 0.443s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:53 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Lock "cinder-2f916995-a2f2-460c-89db-d17bf8cbb635-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe" returned: 0 in 0.503s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-fef06055-42e0-4aa7-b98f-80bbf453b70d" released by "delete_volume" :: held 0.956s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:53 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.info Apr 15 13:36:53 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Acquiring lock "cinder-quobyte-2f916995-a2f2-460c-89db-d17bf8cbb635" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Lock "cinder-quobyte-2f916995-a2f2-460c-89db-d17bf8cbb635" acquired by "delete_volume" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2486f9-6bcc-4363-8cd7-454159a398c7]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created reservations ['aa3b1870-1e38-4084-b5bb-a2970f034191', '4d545d3b-23f2-4e35-b948-efaa73089959', '07594078-b4ea-45eb-9055-bc0d6eee00ee', '31adb16b-972b-4b7a-ac4a-3ac7172210b5'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:53 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:53 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:53 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635 Apr 15 13:36:53 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:54 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.info" returned: 0 in 0.416s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:54 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:54 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.info Apr 15 13:36:54 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:54 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.417s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:54 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Deleted volume successfully. Apr 15 13:36:54 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9665e964-c07c-4947-bb44-11d10b228a50 tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-fef06055-42e0-4aa7-b98f-80bbf453b70d-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635" returned: 0 in 0.508s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:54 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635 Apr 15 13:36:54 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:54 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.info" returned: 0 in 0.404s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.924s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.658s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1757331459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731bf985-565f-4a77-b782-1cf77d55a83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eed4b894a64145928f966810b80876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:52Z,use_quota=True,user_id='03b7adcd25874c2fa38ae0243502fac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Creating volume 731bf985-565f-4a77-b782-1cf77d55a83c {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:54 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:54 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c 1073741824 Apr 15 13:36:54 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:54 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-19b7ee3f-64fc-4dc5-b9bb-e76ba1c27ec2 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot 9baa7e08-d842-41a9-a3b2-08bd9089309d: created successfully Apr 15 13:36:54 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f916995-a2f2-460c-89db-d17bf8cbb635" returned: 0 in 0.407s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Lock "cinder-quobyte-2f916995-a2f2-460c-89db-d17bf8cbb635" released by "delete_volume" :: held 0.938s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Created reservations ['1208dd19-db39-44b3-a738-1f820be4442d', '123f5a9d-770e-4d2f-ad37-204663477e65', 'bdd11b91-fff5-4404-b98e-6f2de079d6f9', '8aac748d-0e8c-4b94-b73b-70a8789c8759'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:54 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:54 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-quobyte-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94" acquired by "delete_volume" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d9d75e-3c7a-4255-85e5-813523b53826]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:55 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 Apr 15 13:36:55 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:55 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c 1073741824" returned: 0 in 0.575s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Flow 'volume_create_manager' (47bdc995-29a2-4831-971f-dc6b8ceb588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adcfdad-b66a-4a3e-a08b-c775a532b5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:55 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c Apr 15 13:36:55 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adcfdad-b66a-4a3e-a08b-c775a532b5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-923729089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca154148-4217-48e6-9963-9882ca5974a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d95529bf694e37a3006fc4d3b00d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:55Z,use_quota=True,user_id='ebd30f8ea6f3454baca28e6dd773162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5095a39c-4f46-46e8-b772-e1a0db36757d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5095a39c-4f46-46e8-b772-e1a0db36757d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e51a63-115f-44c1-951d-1504d8c46844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e51a63-115f-44c1-951d-1504d8c46844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca154148-4217-48e6-9963-9882ca5974a8', 'volume_name': 'volume-ca154148-4217-48e6-9963-9882ca5974a8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0024e49-aeba-4b99-b48d-0fa157cab70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0024e49-aeba-4b99-b48d-0fa157cab70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19043db6-d78b-4e7a-98fd-1fe0f61b4e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:55 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Volume ca154148-4217-48e6-9963-9882ca5974a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca154148-4217-48e6-9963-9882ca5974a8', 'volume_size': 1} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:55 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.495s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:55 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Deleted volume successfully. Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e2bc39bd-223c-48ba-b326-9e36e18f60c9 tempest-VolumesTransfersV355Test-1567365697 None] Lock "cinder-2f916995-a2f2-460c-89db-d17bf8cbb635-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:55 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:55 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot 9baa7e08-d842-41a9-a3b2-08bd9089309d: deleting Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94" returned: 0 in 0.535s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:55 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94 Apr 15 13:36:55 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot 9baa7e08-d842-41a9-a3b2-08bd9089309d: deleting {{(pid=82595) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-a7431445-f92e-4cac-933c-b5f5c176b439" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-a7431445-f92e-4cac-933c-b5f5c176b439" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-25066eaa-b476-4341-978e-d9da6a7a7cbe" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-25066eaa-b476-4341-978e-d9da6a7a7cbe" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Deleting offline snapshot 25066eaa-b476-4341-978e-d9da6a7a7cbe of volume a7431445-f92e-4cac-933c-b5f5c176b439 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] snapshot_file for this snap is: volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6850e1c-ae68-45b6-94f7-e7436fd2ca15]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:55 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c" returned: 0 in 0.458s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-923729089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca154148-4217-48e6-9963-9882ca5974a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d95529bf694e37a3006fc4d3b00d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:36:55Z,use_quota=True,user_id='ebd30f8ea6f3454baca28e6dd773162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Creating volume ca154148-4217-48e6-9963-9882ca5974a8 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:36:55 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:55 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe Apr 15 13:36:55 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b31475-8540-424b-88a9-2276664e9889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731bf985-565f-4a77-b782-1cf77d55a83c', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:55 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8 1073741824 Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acc200d-eb5d-4a92-b115-aba81ee73f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:55 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:55 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Volume volume-731bf985-565f-4a77-b782-1cf77d55a83c (731bf985-565f-4a77-b782-1cf77d55a83c): created successfully Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acc200d-eb5d-4a92-b115-aba81ee73f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Flow 'volume_create_manager' (4bfeb360-5dd5-4661-8d78-116da6323ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:55 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-25a4e60f-f846-4d7c-93c4-3fb1763c6d39 tempest-SnapshotMetadataTestJSON-1319601407 None] Created volume successfully. Apr 15 13:36:55 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94" returned: 0 in 0.448s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94" released by "delete_volume" :: held 1.011s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created reservations ['f45d5d68-9d9e-48bf-9cd0-d9ceb0062304', 'adfad71e-9045-40fb-b3df-898d60467bf8', '59cfe94b-8a7c-4b09-b6e4-1b1394241e96', '0cd12481-4a43-49cd-af0e-bfe694505548'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:56 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:56 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:56 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe" returned: 0 in 0.557s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7431445-f92e-4cac-933c-b5f5c176b439(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[8293b3ae-a309-4207-9bd9-68e43560b3e1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:56 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8 1073741824" returned: 0 in 0.542s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:56 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8 Apr 15 13:36:56 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:56 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 Apr 15 13:36:56 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:56 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.490s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:56 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Deleted volume successfully. Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e98fc194-16d1-4ac3-a5b7-a70fb1a7287f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-7dfde1fe-5704-4fb8-ad1e-cfb66cd10d94-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:56 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8" returned: 0 in 0.424s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.458s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19043db6-d78b-4e7a-98fd-1fe0f61b4e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca154148-4217-48e6-9963-9882ca5974a8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24210db4-4950-427d-9315-b1d48ccd8ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:36:56 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Volume volume-ca154148-4217-48e6-9963-9882ca5974a8 (ca154148-4217-48e6-9963-9882ca5974a8): created successfully Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24210db4-4950-427d-9315-b1d48ccd8ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Flow 'volume_create_manager' (47bdc995-29a2-4831-971f-dc6b8ceb588b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Creating offline snapshot 73c331a6-cceb-4ded-80fc-a14ab43bba49 of volume 731bf985-565f-4a77-b782-1cf77d55a83c {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:36:56 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6c5d6298-3e71-40d6-84c8-d8146d9e97a8 tempest-VolumesTransfersV355Test-716614204 None] Created volume successfully. Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cc6e71-4160-4de5-bc6c-5bd5f345ba42]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:56 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439" returned: 0 in 0.539s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:56 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe Apr 15 13:36:56 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:56 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c Apr 15 13:36:56 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-8b2570b2-bba6-461f-84bb-d628a07857b1-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-8b2570b2-bba6-461f-84bb-d628a07857b1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-quobyte-8b2570b2-bba6-461f-84bb-d628a07857b1" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-8b2570b2-bba6-461f-84bb-d628a07857b1" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cf389b-0efa-4cac-a679-03b90af19156]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:57 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1 Apr 15 13:36:57 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:57 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c" returned: 0 in 0.487s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:57 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 1G Apr 15 13:36:57 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:57 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe" returned: 0 in 0.493s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:57 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe Apr 15 13:36:57 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Acquiring lock "cinder-ca154148-4217-48e6-9963-9882ca5974a8-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Lock "cinder-ca154148-4217-48e6-9963-9882ca5974a8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Acquiring lock "cinder-quobyte-ca154148-4217-48e6-9963-9882ca5974a8" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Lock "cinder-quobyte-ca154148-4217-48e6-9963-9882ca5974a8" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c8f074-0ce6-47a1-b9f0-c6ecce78c304]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:57 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1" returned: 0 in 0.536s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:57 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1 Apr 15 13:36:57 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:57 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8 Apr 15 13:36:57 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:57 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439.25066eaa-b476-4341-978e-d9da6a7a7cbe" returned: 0 in 0.519s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-25066eaa-b476-4341-978e-d9da6a7a7cbe" released by "_delete_snapshot" :: held 2.175s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-a7431445-f92e-4cac-933c-b5f5c176b439" released by "delete_snapshot" :: held 2.190s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:57 devstack cinder-volume[82595]: WARNING cinder.quota [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-352716930 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-352716930, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:36:57 devstack cinder-volume[82595]: WARNING cinder.quota [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-352716930 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-352716930, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['c2b4e979-77ac-48ba-88fd-47592bf8b6d0', '2c8033cb-e7cd-4c4b-bf3d-e4cfd587dae9', '2fd995a7-e178-4b8b-bbc2-a1af96127e97', 'cc730b88-64d2-46d6-b0a0-c166e9c6295f'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:57 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 1G" returned: 0 in 0.626s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731bf985-565f-4a77-b782-1cf77d55a83c -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:57 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731bf985-565f-4a77-b782-1cf77d55a83c -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 Apr 15 13:36:57 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:57 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-46556ad3-d829-4d73-a4f2-62475a6959e9 tempest-GroupSnapshotsTest-1876803718 None] group_snapshot 9baa7e08-d842-41a9-a3b2-08bd9089309d: deleted successfully Apr 15 13:36:58 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8b2570b2-bba6-461f-84bb-d628a07857b1" returned: 0 in 0.461s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-8b2570b2-bba6-461f-84bb-d628a07857b1" released by "delete_volume" :: held 1.018s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created reservations ['08d01acd-b9c2-47f9-883b-d9dbbfd1d521', 'bbdef72d-ba4f-4eff-bdb5-63eb540e0e59', '2d27bc3c-d02d-4a2e-a565-5b6a9a0de8a4', '76bf7a66-069d-4ad7-946f-4e5cec63c57a'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:58 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8" returned: 0 in 0.535s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:58 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8 Apr 15 13:36:58 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:58 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:58 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:58 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731bf985-565f-4a77-b782-1cf77d55a83c -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49" returned: 0 in 0.444s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:58 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 is being set with open permissions: ugo+rw Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:58 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 Apr 15 13:36:58 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:58 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ca154148-4217-48e6-9963-9882ca5974a8" returned: 0 in 0.420s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:58 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Lock "cinder-quobyte-ca154148-4217-48e6-9963-9882ca5974a8" released by "delete_volume" :: held 0.991s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.431s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:58 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Deleted volume successfully. Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Created reservations ['d9033632-0dc9-4730-962d-2f8e03560977', '9bc4175e-a03f-4795-a446-7942d3f70dce', '4127eae7-340d-4a38-91d8-c012c6d0af96', '76cf0e28-0e57-4724-b556-7ebea0cf4c10'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-257a8e17-99b1-4c58-b712-2491f414815f tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-8b2570b2-bba6-461f-84bb-d628a07857b1-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:58 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:36:58 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:58 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49" returned: 0 in 0.455s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:58 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.info Apr 15 13:36:58 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "cinder-quobyte-a7431445-f92e-4cac-933c-b5f5c176b439" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-a7431445-f92e-4cac-933c-b5f5c176b439" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[95262f78-7b5c-46a3-97e4-0d7d25d6ba2f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:58 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 Apr 15 13:36:58 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:59 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.474s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:36:59 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Deleted volume successfully. Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4b6e1e23-0ee5-43c1-a5fa-1052d20e4ca2 tempest-VolumesTransfersV355Test-1567365697 None] Lock "cinder-ca154148-4217-48e6-9963-9882ca5974a8-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-b3b04667-1801-4b8a-8536-df9dfc331cda-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:59 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-b3b04667-1801-4b8a-8536-df9dfc331cda-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.info" returned: 0 in 0.479s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:59 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.info is being set with open permissions: ugo+rw Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:59 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.info Apr 15 13:36:59 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-quobyte-b3b04667-1801-4b8a-8536-df9dfc331cda" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-b3b04667-1801-4b8a-8536-df9dfc331cda" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f42bff-9407-4628-9245-da67ad45c507]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:59 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda Apr 15 13:36:59 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:59 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439" returned: 0 in 0.516s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:59 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439 Apr 15 13:36:59 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:59 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.info" returned: 0 in 0.437s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.009s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:36:59 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-ea09221e-4a75-41c6-8b3d-9ddf619456c8 tempest-SnapshotMetadataTestJSON-1319601407 None] Create snapshot completed successfully Apr 15 13:36:59 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda" returned: 0 in 0.497s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:36:59 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda Apr 15 13:36:59 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:36:59 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a7431445-f92e-4cac-933c-b5f5c176b439" returned: 0 in 0.442s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Lock "cinder-quobyte-a7431445-f92e-4cac-933c-b5f5c176b439" released by "delete_volume" :: held 0.991s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['26e2f23f-2e44-40ce-bec1-fab8efc1e982'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:36:59 devstack cinder-volume[82595]: WARNING cinder.quota [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-352716930 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-352716930, it is now deprecated. Please use the default quota class for default quota. Apr 15 13:36:59 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Created reservations ['9dfd6700-3c88-404b-9764-ca66c6dd64b0', '99ac9ece-e4af-45c5-82a1-b734e9916e44', 'f559ae67-2fe5-4cef-98a2-ee82ba68d8bf', 'fe2210d6-9009-4d19-bbfe-60563aa76dbc'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:00 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:00 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:00 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b3b04667-1801-4b8a-8536-df9dfc331cda" returned: 0 in 0.468s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-b3b04667-1801-4b8a-8536-df9dfc331cda" released by "delete_volume" :: held 0.991s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created reservations ['a1ec7c7e-456c-4622-92a5-c9eec065a9fc', 'be933597-3384-4f3b-a910-b356e2b5549d', '828db28d-3942-4863-a776-79a4ff36dd3a', 'e1d5c890-a26f-42e9-8497-a980f5f61947'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:00 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:00 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:00 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.532s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:00 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-383c72e5-54f7-428d-822b-1595f21a839f tempest-GroupSnapshotsTest-1876803718 None] Delete group completed successfully. Apr 15 13:37:00 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.458s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:00 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Deleted volume successfully. Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0876e3f8-490d-490e-afd9-90817c7b309a tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-b3b04667-1801-4b8a-8536-df9dfc331cda-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Acquiring lock "cinder-73c331a6-cceb-4ded-80fc-a14ab43bba49-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "cinder-73c331a6-cceb-4ded-80fc-a14ab43bba49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Acquiring lock "cinder-quobyte-731bf985-565f-4a77-b782-1cf77d55a83c" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "cinder-quobyte-731bf985-565f-4a77-b782-1cf77d55a83c" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Acquiring lock "cinder-quobyte-73c331a6-cceb-4ded-80fc-a14ab43bba49" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "cinder-quobyte-73c331a6-cceb-4ded-80fc-a14ab43bba49" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Deleting offline snapshot 73c331a6-cceb-4ded-80fc-a14ab43bba49 of volume 731bf985-565f-4a77-b782-1cf77d55a83c {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] snapshot_file for this snap is: volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[35369ca9-f3bf-4ad2-a58c-ba9670aa9b92]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:01 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 Apr 15 13:37:01 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "cinder-quobyte-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:01 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c8d440-6fe9-4f27-8e2d-932947d5e518]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:01 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49" returned: 0 in 0.604s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:01 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731bf985-565f-4a77-b782-1cf77d55a83c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:01 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 Apr 15 13:37:01 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:01 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d45267d-27f3-4128-b8fa-c9ef4bb82049]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:01 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c Apr 15 13:37:01 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:02 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52" returned: 0 in 0.581s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:02 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52 Apr 15 13:37:02 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:02 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c" returned: 0 in 0.617s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:02 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 Apr 15 13:37:02 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:02 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52" returned: 0 in 0.548s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-quobyte-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52" released by "delete_volume" :: held 1.168s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Created reservations ['443e82e1-4938-45ce-a2da-712bb48cd68f', 'a47fee4c-e21b-4e52-bbd0-b78f55c7666d', '33a990b7-5c94-4bd3-ad1b-7eda435155e2', '6fbf3739-0bfe-4e7f-8a7c-573145d5c772'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:02 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:02 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:02 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49" returned: 0 in 0.642s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:02 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49 Apr 15 13:37:02 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:03 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.569s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:03 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Deleted volume successfully. Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9571a1be-796a-40d6-a248-74ddbdd6fddc tempest-CreateVolumesFromSourceVolumeTest-1921664774 None] Lock "cinder-60d042a9-b02e-4ce8-b9cb-c3de9bb60f52-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:03 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c.73c331a6-cceb-4ded-80fc-a14ab43bba49" returned: 0 in 0.559s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=290,cinder:UPDATE=365,cinder:INSERT=101,cinder:DELETE=23 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "cinder-quobyte-73c331a6-cceb-4ded-80fc-a14ab43bba49" released by "_delete_snapshot" :: held 2.502s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "cinder-quobyte-731bf985-565f-4a77-b782-1cf77d55a83c" released by "delete_snapshot" :: held 2.512s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Created reservations ['74a39854-1568-4b7e-b70f-9aee8e21aff3', '4bb604d6-32b1-4146-83ac-6318cc6588b4', '6e5d9cf2-f103-4f5c-8e3b-8e907c4e01a3', '96eb7cc3-9774-4e49-b5e2-c1b88414a74e'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:03 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Delete snapshot completed successfully. Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa87e8ba-4974-4d10-81f4-92ba20aee1c0 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "cinder-73c331a6-cceb-4ded-80fc-a14ab43bba49-delete_snapshot" released by "delete_snapshot" :: held 2.594s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Flow 'volume_create_manager' (d1d56a8f-5dd4-43a7-aa3a-f4f7897f1357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b9a0f2-6a30-40e3-a97f-768a35511069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b9a0f2-6a30-40e3-a97f-768a35511069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-984743057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312469ff-e581-41cd-8a98-3e6409fd98a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640ffb0605bb4127a446b9cdf5649285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:04Z,use_quota=True,user_id='8759e56d6001413fb1ed3cb8c10686ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818317cd-fb6d-40a9-a9b3-4b971af43b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818317cd-fb6d-40a9-a9b3-4b971af43b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73452a23-16f7-481f-895f-9912a3b5d13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73452a23-16f7-481f-895f-9912a3b5d13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312469ff-e581-41cd-8a98-3e6409fd98a6', 'volume_name': 'volume-312469ff-e581-41cd-8a98-3e6409fd98a6', 'volume_size': 2}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85f965c-ee94-4e6f-9160-4525dbb20a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85f965c-ee94-4e6f-9160-4525dbb20a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a14996-b51b-4c3b-a071-d652960d24b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:03 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Volume 312469ff-e581-41cd-8a98-3e6409fd98a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312469ff-e581-41cd-8a98-3e6409fd98a6', 'volume_size': 2} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-984743057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312469ff-e581-41cd-8a98-3e6409fd98a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640ffb0605bb4127a446b9cdf5649285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:04Z,use_quota=True,user_id='8759e56d6001413fb1ed3cb8c10686ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Creating volume 312469ff-e581-41cd-8a98-3e6409fd98a6 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:03 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6 2147483648 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:03 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6 2147483648 Apr 15 13:37:03 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Acquiring lock "cinder-731bf985-565f-4a77-b782-1cf77d55a83c-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "cinder-731bf985-565f-4a77-b782-1cf77d55a83c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=278,cinder:UPDATE=375,cinder:INSERT=84,cinder:DELETE=32 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Acquiring lock "cinder-quobyte-731bf985-565f-4a77-b782-1cf77d55a83c" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "cinder-quobyte-731bf985-565f-4a77-b782-1cf77d55a83c" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d36848-97ca-4bed-9bf0-7d5f5def4ce1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:04 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c Apr 15 13:37:04 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:04 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6 2147483648" returned: 0 in 0.643s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:04 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6 Apr 15 13:37:04 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:04 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c" returned: 0 in 0.614s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:04 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c Apr 15 13:37:04 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:04 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6" returned: 0 in 0.525s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a14996-b51b-4c3b-a071-d652960d24b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312469ff-e581-41cd-8a98-3e6409fd98a6', 'volume_size': 2}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8e3322-3f64-4058-a6c2-e180e98db2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:04 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Volume volume-312469ff-e581-41cd-8a98-3e6409fd98a6 (312469ff-e581-41cd-8a98-3e6409fd98a6): created successfully Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8e3322-3f64-4058-a6c2-e180e98db2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Flow 'volume_create_manager' (d1d56a8f-5dd4-43a7-aa3a-f4f7897f1357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:04 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-46efcc5d-e2f8-4f1e-8254-c09d74fb5ea9 tempest-VolumesCloneNegativeTest-1098064702 None] Created volume successfully. Apr 15 13:37:05 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-731bf985-565f-4a77-b782-1cf77d55a83c" returned: 0 in 0.522s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "cinder-quobyte-731bf985-565f-4a77-b782-1cf77d55a83c" released by "delete_volume" :: held 1.174s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Created reservations ['63c96ac7-7ce4-4c47-a540-00015ac4d269', 'd295d8d1-a3b0-482e-b77e-d91b6ab89020', 'f26015b1-4d39-4009-83ce-cfb24e67be45', 'c07f8aa6-298c-4c41-ae5b-a673d6245b31'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:05 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:05 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Acquiring lock "cinder-312469ff-e581-41cd-8a98-3e6409fd98a6-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Lock "cinder-312469ff-e581-41cd-8a98-3e6409fd98a6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:05 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.504s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:05 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:06 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Deleted volume successfully. Apr 15 13:37:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Acquiring lock "cinder-quobyte-312469ff-e581-41cd-8a98-3e6409fd98a6" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-867017d4-b60a-45db-a382-bfeb7d8b6257 tempest-SnapshotMetadataTestJSON-1319601407 None] Lock "cinder-731bf985-565f-4a77-b782-1cf77d55a83c-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Lock "cinder-quobyte-312469ff-e581-41cd-8a98-3e6409fd98a6" acquired by "delete_volume" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:06 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c820c9c-2760-462e-b893-f56ac0993ac1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:06 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6 Apr 15 13:37:06 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:06 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6" returned: 0 in 0.573s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:06 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6 Apr 15 13:37:06 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:07 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-312469ff-e581-41cd-8a98-3e6409fd98a6" returned: 0 in 0.535s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Lock "cinder-quobyte-312469ff-e581-41cd-8a98-3e6409fd98a6" released by "delete_volume" :: held 1.131s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Created reservations ['c4cedd62-d000-44ce-b61a-1c59d294b908', '12d769e7-4301-4c60-b735-4a7e8b5770f6', '68472b2a-2f95-488a-80ed-0e6ff454c84a', 'addf181e-cd3a-4e67-8da4-087c69646915'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:07 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:07 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:07 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.448s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:07 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Deleted volume successfully. Apr 15 13:37:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e05bce15-3d84-41c6-b8e5-60c4a36208d1 tempest-VolumesCloneNegativeTest-1098064702 None] Lock "cinder-312469ff-e581-41cd-8a98-3e6409fd98a6-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Flow 'volume_create_manager' (bc658488-d65f-45d9-ba54-03a26e351a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2922f831-5138-426c-be7d-89ba951205c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2922f831-5138-426c-be7d-89ba951205c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1189931232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6f6e05-e439-4505-8663-20df8124f330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce11a3fd124bf98f9a966e8c0fd7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:08Z,use_quota=True,user_id='028398e8ea5c4521b16a75135fe8eb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e799167-d1ec-4d9a-b250-937bb85b1264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e799167-d1ec-4d9a-b250-937bb85b1264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192afc56-1ce6-42e0-84e9-d551915de973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192afc56-1ce6-42e0-84e9-d551915de973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6f6e05-e439-4505-8663-20df8124f330', 'volume_name': 'volume-fe6f6e05-e439-4505-8663-20df8124f330', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0754ec-9798-413f-8172-22a6680af10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0754ec-9798-413f-8172-22a6680af10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0c0c19-7493-4ae3-885c-6df24ec64f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:08 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Volume fe6f6e05-e439-4505-8663-20df8124f330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6f6e05-e439-4505-8663-20df8124f330', 'volume_size': 1} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1189931232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6f6e05-e439-4505-8663-20df8124f330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce11a3fd124bf98f9a966e8c0fd7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:08Z,use_quota=True,user_id='028398e8ea5c4521b16a75135fe8eb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Creating volume fe6f6e05-e439-4505-8663-20df8124f330 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:08 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:08 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330 1073741824 Apr 15 13:37:08 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:08 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330 1073741824" returned: 0 in 0.528s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:08 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330 Apr 15 13:37:08 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:09 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0c0c19-7493-4ae3-885c-6df24ec64f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6f6e05-e439-4505-8663-20df8124f330', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65830ca4-1c49-4789-82d4-b45e68a136e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:09 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Volume volume-fe6f6e05-e439-4505-8663-20df8124f330 (fe6f6e05-e439-4505-8663-20df8124f330): created successfully Apr 15 13:37:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65830ca4-1c49-4789-82d4-b45e68a136e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Flow 'volume_create_manager' (bc658488-d65f-45d9-ba54-03a26e351a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:09 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-257b5024-067f-442b-8f16-43f1f8a3515b tempest-VolumesMetadataTest-1435897508 None] Created volume successfully. Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Flow 'volume_create_manager' (aa0081cc-a065-464b-ad3a-1af5d0a3e455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248b24e2-5ab2-4ab0-a2e8-6356ddd2d871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248b24e2-5ab2-4ab0-a2e8-6356ddd2d871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1838733338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790546a0d3a046b58e9215994461c75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:10Z,use_quota=True,user_id='388f71af4fa54ef6a78990d1a24fda29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc421aeb-6774-4cbc-b4bb-d1eddfbb91ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc421aeb-6774-4cbc-b4bb-d1eddfbb91ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbc5640-1fbf-4b29-a03f-9aeefc45e4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.image.glance [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Creating Keystone auth plugin from conf {{(pid=82595) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbc5640-1fbf-4b29-a03f-9aeefc45e4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d', 'volume_name': 'volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8dd614d-318d-4794-8096-1df3c80625d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8dd614d-318d-4794-8096-1df3c80625d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b0d694-5dfe-4ad6-a04c-53b6d9884ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:10 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Volume 9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Trying to clone 9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d from image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]). {{(pid=82595) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 13:37:10 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Image download 20.69 MB at 20.69 MB/s Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f2cef-58a9-47b3-9225-8b55043e7604]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:10 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD Apr 15 13:37:10 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Acquiring lock "cinder-fe6f6e05-e439-4505-8663-20df8124f330-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Lock "cinder-fe6f6e05-e439-4505-8663-20df8124f330-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Acquiring lock "cinder-quobyte-fe6f6e05-e439-4505-8663-20df8124f330" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Lock "cinder-quobyte-fe6f6e05-e439-4505-8663-20df8124f330" acquired by "delete_volume" :: waited 0.017s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d54771b-7dab-4e9c-b7a3-1abcb1ee8a20]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:11 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Temporary image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 is fetched for user 388f71af4fa54ef6a78990d1a24fda29. {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 13:37:11 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330 Apr 15 13:37:11 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ce4670-01f5-47e1-8d07-fa54f4e233c7]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:11 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD Apr 15 13:37:11 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:11 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330" returned: 0 in 0.546s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:11 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330 Apr 15 13:37:11 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:11 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1838733338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790546a0d3a046b58e9215994461c75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:10Z,use_quota=True,user_id='388f71af4fa54ef6a78990d1a24fda29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Creating volume 9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:11 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:11 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d 1073741824 Apr 15 13:37:11 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:11 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-fe6f6e05-e439-4505-8663-20df8124f330" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Lock "cinder-quobyte-fe6f6e05-e439-4505-8663-20df8124f330" released by "delete_volume" :: held 1.046s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Created reservations ['3e3d965a-fcc1-4ef1-8094-47cc84f1d333', '1280e04a-8b32-4f85-bc84-686895b83f7d', '521399a6-a89a-4313-8808-dbe02d9268ce', '797a4e1c-7c7b-4466-968e-8621e833e165'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:12 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:12 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:12 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d 1073741824" returned: 0 in 0.590s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:12 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d Apr 15 13:37:12 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:12 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.541s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:12 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Deleted volume successfully. Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cef7eb8f-d3e7-475f-931a-b54016a61c24 tempest-VolumesMetadataTest-1435897508 None] Lock "cinder-fe6f6e05-e439-4505-8663-20df8124f330-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:12 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" returned: 0 in 0.450s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Attempting download of 082fb149-5a21-4aac-9c2e-bdc7043feaf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}])) to volume 9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d. {{(pid=82595) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e921443-72fa-49d4-9a3d-d64e7c5eb0c8]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_29mg5tsr {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:12 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_29mg5tsr Apr 15 13:37:12 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:13 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_29mg5tsr" returned: 0 in 0.576s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_29mg5tsr {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:13 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_29mg5tsr Apr 15 13:37:13 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:13 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_29mg5tsr" returned: 1 in 0.634s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_29mg5tsr' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:37:13 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0a9c2b-efaf-4620-9330-f43c8d081617]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:14 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD Apr 15 13:37:14 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:14 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:14 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] 082fb149-5a21-4aac-9c2e-bdc7043feaf2 was qcow2, converting to raw {{(pid=82595) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 13:37:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:14 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d Apr 15 13:37:14 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:15 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" returned: 0 in 1.026s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:15 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2__fp9h51zdevstack@QuobyteHD, size 112.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:37:15 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Converted 112.00 MB image at 109.01 MB/s Apr 15 13:37:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:15 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d 1G Apr 15 13:37:15 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:16 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d 1G" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c6641f-f29b-42e3-bfac-dc9bad5f6e52]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:16 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d Apr 15 13:37:16 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Flow 'volume_create_manager' (26dc5fdb-d4b4-4d1d-82b0-9a80ddfbe781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c517f9a-ca3f-480b-80dc-5e7571e10354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c517f9a-ca3f-480b-80dc-5e7571e10354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-951055052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffeea24-0b5e-484c-aff4-5018833ef15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa30868d13d4b0f9d496a59cd864942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:16Z,use_quota=True,user_id='e0fbcb225d11487c87e0e5aaff7b93d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfed4c75-e355-4d26-8fc8-2a94c419af49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfed4c75-e355-4d26-8fc8-2a94c419af49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835ec9c9-c735-47fb-ab00-bb75b847ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835ec9c9-c735-47fb-ab00-bb75b847ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ffeea24-0b5e-484c-aff4-5018833ef15e', 'volume_name': 'volume-3ffeea24-0b5e-484c-aff4-5018833ef15e', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007f6ece-2485-43ea-9cc4-7c56ab490ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007f6ece-2485-43ea-9cc4-7c56ab490ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f133533f-b52a-4b2c-aaf1-a80a877349bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:16 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Volume 3ffeea24-0b5e-484c-aff4-5018833ef15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ffeea24-0b5e-484c-aff4-5018833ef15e', 'volume_size': 1} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-951055052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffeea24-0b5e-484c-aff4-5018833ef15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa30868d13d4b0f9d496a59cd864942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:16Z,use_quota=True,user_id='e0fbcb225d11487c87e0e5aaff7b93d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Creating volume 3ffeea24-0b5e-484c-aff4-5018833ef15e {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:16 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:16 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e 1073741824 Apr 15 13:37:16 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:16 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" returned: 0 in 0.573s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:16 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d Apr 15 13:37:16 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:16 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e 1073741824" returned: 0 in 0.547s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:16 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e Apr 15 13:37:16 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:17 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" returned: 1 in 0.551s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Downloaded image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}])) to volume 9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d successfully. {{(pid=82595) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Temporary image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 for user 388f71af4fa54ef6a78990d1a24fda29 is deleted. {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Marking volume 9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d as bootable. {{(pid=82595) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Copying metadata from image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 to 9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d. {{(pid=82595) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Creating volume glance metadata for volume 9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d backed by image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82595) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b0d694-5dfe-4ad6-a04c-53b6d9884ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0b0a67-e883-4f38-b426-f9996816844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:17 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Volume volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d (9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d): created successfully Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0b0a67-e883-4f38-b426-f9996816844a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Flow 'volume_create_manager' (aa0081cc-a065-464b-ad3a-1af5d0a3e455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:17 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-017e5487-f3fa-4421-8636-e13d6b5a4ad2 tempest-VolumesExtendTest-1768351488 None] Created volume successfully. Apr 15 13:37:17 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e" returned: 0 in 0.465s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f133533f-b52a-4b2c-aaf1-a80a877349bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffeea24-0b5e-484c-aff4-5018833ef15e', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43d7f4d-1ab2-4b05-86b5-f60ea211bfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:17 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Volume volume-3ffeea24-0b5e-484c-aff4-5018833ef15e (3ffeea24-0b5e-484c-aff4-5018833ef15e): created successfully Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43d7f4d-1ab2-4b05-86b5-f60ea211bfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Flow 'volume_create_manager' (26dc5fdb-d4b4-4d1d-82b0-9a80ddfbe781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:17 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6ee6b645-0b0c-4235-9388-ec5c8a383daa tempest-VolumesTransfersTest-619250114 None] Created volume successfully. Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4021fb28-b8ea-45ca-96d3-1bb9f9238460]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:17 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d Apr 15 13:37:17 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:18 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" returned: 0 in 0.484s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:18 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d Apr 15 13:37:18 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Flow 'volume_create_manager' (52e7d83f-3e19-404e-903f-f2387d37e110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08edba3b-dd4e-457e-905e-25e50f1a7aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08edba3b-dd4e-457e-905e-25e50f1a7aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-977858160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5334f3-0c64-444b-883a-c5e62565b841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa85756daa148fa9d15e910f95842d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:18Z,use_quota=True,user_id='854cd2d5f7f74613a074e58d690953e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21ee624-a092-4e2c-b29f-7e8a5db2ee94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21ee624-a092-4e2c-b29f-7e8a5db2ee94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c181db1a-8477-466e-be99-a57bbdac7bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c181db1a-8477-466e-be99-a57bbdac7bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5334f3-0c64-444b-883a-c5e62565b841', 'volume_name': 'volume-5f5334f3-0c64-444b-883a-c5e62565b841', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f3bdc3-4dfd-4773-b0f6-38f3d6a76912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f3bdc3-4dfd-4773-b0f6-38f3d6a76912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aba8ca5-609c-4a5a-a3d8-961723c15b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:18 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Volume 5f5334f3-0c64-444b-883a-c5e62565b841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5334f3-0c64-444b-883a-c5e62565b841', 'volume_size': 1} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:18 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" returned: 1 in 0.538s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d 2G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d 2G" returned: 0 in 0.050s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.101s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-977858160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5334f3-0c64-444b-883a-c5e62565b841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa85756daa148fa9d15e910f95842d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:18Z,use_quota=True,user_id='854cd2d5f7f74613a074e58d690953e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Creating volume 5f5334f3-0c64-444b-883a-c5e62565b841 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:18 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:18 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841 1073741824 Apr 15 13:37:18 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:18 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-d798edc4-8a85-4212-b944-35a2fcc0bae8 tempest-VolumesTransfersTest-1321893512 None] Transfer volume completed successfully. Apr 15 13:37:18 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-12877700-4612-4b81-8bb8-6122546be344 tempest-VolumesExtendTest-1768351488 None] Extend volume completed successfully. Apr 15 13:37:19 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841 1073741824" returned: 0 in 0.464s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:19 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841 Apr 15 13:37:19 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Acquiring lock "cinder-3ffeea24-0b5e-484c-aff4-5018833ef15e-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Lock "cinder-3ffeea24-0b5e-484c-aff4-5018833ef15e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Acquiring lock "cinder-quobyte-3ffeea24-0b5e-484c-aff4-5018833ef15e" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Lock "cinder-quobyte-3ffeea24-0b5e-484c-aff4-5018833ef15e" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57d83f7-1bac-45e5-9f49-eccc26ef6180]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:19 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841" returned: 0 in 0.464s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aba8ca5-609c-4a5a-a3d8-961723c15b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5334f3-0c64-444b-883a-c5e62565b841', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900ab00d-2e10-46da-a15d-148d299587f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:19 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e Apr 15 13:37:19 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:19 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Volume volume-5f5334f3-0c64-444b-883a-c5e62565b841 (5f5334f3-0c64-444b-883a-c5e62565b841): created successfully Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900ab00d-2e10-46da-a15d-148d299587f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Flow 'volume_create_manager' (52e7d83f-3e19-404e-903f-f2387d37e110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:19 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-637adf4f-13cf-4fad-b77a-75829767f4a4 tempest-VolumesServicesTestJSON-954138535 None] Created volume successfully. Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Acquiring lock "cinder-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Lock "cinder-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Acquiring lock "cinder-quobyte-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Lock "cinder-quobyte-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fe41a1-1ce7-4879-9a57-8495bc813729]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:20 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d Apr 15 13:37:20 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:20 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e" returned: 0 in 0.473s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:20 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e Apr 15 13:37:20 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:20 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" returned: 0 in 0.499s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Acquiring lock "cinder-5f5334f3-0c64-444b-883a-c5e62565b841-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:20 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3ffeea24-0b5e-484c-aff4-5018833ef15e" returned: 0 in 0.407s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Lock "cinder-5f5334f3-0c64-444b-883a-c5e62565b841-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Lock "cinder-quobyte-3ffeea24-0b5e-484c-aff4-5018833ef15e" released by "delete_volume" :: held 0.910s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:20 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d Apr 15 13:37:20 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Acquiring lock "cinder-quobyte-5f5334f3-0c64-444b-883a-c5e62565b841" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Lock "cinder-quobyte-5f5334f3-0c64-444b-883a-c5e62565b841" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9a2995-bb76-451e-9d26-69e10ade0764]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Created reservations ['caf84e15-9fdf-4716-94ca-fed481b0fda2', '86908883-b59b-4506-819d-228cf7f060f6', '988346ab-2d24-41ed-8e98-5978b27d5404', '7cc9488e-243a-42de-86cc-17ce77243af8'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:20 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841 Apr 15 13:37:20 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:20 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:20 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Flow 'volume_create_manager' (bace28ab-5d54-4c44-88b3-2f1e1865a8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b7a4ee-de8a-4974-b6fa-11b675d5654c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b7a4ee-de8a-4974-b6fa-11b675d5654c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1197924141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29130619-dc86-40d9-b5f1-4f99b95614b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa30868d13d4b0f9d496a59cd864942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:21Z,use_quota=True,user_id='e0fbcb225d11487c87e0e5aaff7b93d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:20 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da72cc9-bc76-4adb-a4c3-2ec72fe501a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da72cc9-bc76-4adb-a4c3-2ec72fe501a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e6d288-da15-4a6f-a9d4-8901d6a9f279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e6d288-da15-4a6f-a9d4-8901d6a9f279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29130619-dc86-40d9-b5f1-4f99b95614b5', 'volume_name': 'volume-29130619-dc86-40d9-b5f1-4f99b95614b5', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828a1444-ddd5-46ca-8403-fb5adb8a9123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828a1444-ddd5-46ca-8403-fb5adb8a9123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c6706f-afcf-4b2a-9978-c87fce5c4d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Volume 29130619-dc86-40d9-b5f1-4f99b95614b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29130619-dc86-40d9-b5f1-4f99b95614b5', 'volume_size': 1} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1197924141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29130619-dc86-40d9-b5f1-4f99b95614b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa30868d13d4b0f9d496a59cd864942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:21Z,use_quota=True,user_id='e0fbcb225d11487c87e0e5aaff7b93d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Creating volume 29130619-dc86-40d9-b5f1-4f99b95614b5 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:21 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" returned: 1 in 0.610s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:21 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5 1073741824 Apr 15 13:37:21 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:21 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d Apr 15 13:37:21 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:21 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841" returned: 0 in 0.553s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:21 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.512s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Deleted volume successfully. Apr 15 13:37:21 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841 Apr 15 13:37:21 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5868422-ebd3-4a26-86bc-5795bace7185 tempest-VolumesTransfersTest-228008021 None] Lock "cinder-3ffeea24-0b5e-484c-aff4-5018833ef15e-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:21 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" returned: 0 in 0.427s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Lock "cinder-quobyte-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d" released by "delete_volume" :: held 1.588s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Created reservations ['ff352eaa-549e-4838-a650-4aeba98b0969', 'e26024bd-8c2e-415a-97e4-b1122f87a9b1', '0ce560ab-3e93-450f-8e3a-24728892a428', '26e0c229-1bc9-4a14-930a-bdc01e53831a'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:21 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5 1073741824" returned: 0 in 0.544s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:21 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f5334f3-0c64-444b-883a-c5e62565b841" returned: 0 in 0.479s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:21 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:21 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Lock "cinder-quobyte-5f5334f3-0c64-444b-883a-c5e62565b841" released by "delete_volume" :: held 1.064s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:21 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5 Apr 15 13:37:21 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Created reservations ['a422e31d-6431-4c46-85f4-dcaadc2bc90d', '53760ab5-1370-4e31-becd-1f4b75b85c4b', '1286b56b-6401-4456-8a29-e8369448eeea', 'bcc2d25f-b276-49b5-a77a-80b8082a5cce'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:21 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:21 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:22 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.450s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:22 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Deleted volume successfully. Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2fbbe6f5-e722-40db-8c3f-52b55e6126b7 tempest-VolumesExtendTest-1768351488 None] Lock "cinder-9c4e3e95-f298-4655-bbf0-ec0fe8b1d24d-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:22 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5" returned: 0 in 0.446s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c6706f-afcf-4b2a-9978-c87fce5c4d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29130619-dc86-40d9-b5f1-4f99b95614b5', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542ab872-9e53-4df0-955b-3bc818e54f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Volume volume-29130619-dc86-40d9-b5f1-4f99b95614b5 (29130619-dc86-40d9-b5f1-4f99b95614b5): created successfully Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542ab872-9e53-4df0-955b-3bc818e54f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Flow 'volume_create_manager' (bace28ab-5d54-4c44-88b3-2f1e1865a8fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:22 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-3edda942-7161-4953-b9f1-50bd3f385f1a tempest-VolumesTransfersTest-619250114 None] Created volume successfully. Apr 15 13:37:22 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.438s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:22 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Deleted volume successfully. Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eb56bf8c-0b2e-4725-a804-37ccdd1aba3b tempest-VolumesServicesTestJSON-954138535 None] Lock "cinder-5f5334f3-0c64-444b-883a-c5e62565b841-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Flow 'volume_create_manager' (9c53a893-1e80-4e1b-baad-5543def0188d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b38fe1a-6a34-40c4-93a9-a316ed680273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b38fe1a-6a34-40c4-93a9-a316ed680273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-661683243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d26672-37ae-4236-8c00-c66b5108088f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790546a0d3a046b58e9215994461c75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:22Z,use_quota=True,user_id='388f71af4fa54ef6a78990d1a24fda29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8aa7ddd-e38a-4cbd-b754-fb179ecf03c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8aa7ddd-e38a-4cbd-b754-fb179ecf03c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cea573-d6d4-4bf5-ad79-e8e136f6fcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cea573-d6d4-4bf5-ad79-e8e136f6fcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d26672-37ae-4236-8c00-c66b5108088f', 'volume_name': 'volume-d9d26672-37ae-4236-8c00-c66b5108088f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde99e0e-9b59-431b-a537-f6f1f0bd6fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde99e0e-9b59-431b-a537-f6f1f0bd6fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afb9cce-5f72-4d11-8fd4-68b3efc3b7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Volume d9d26672-37ae-4236-8c00-c66b5108088f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d26672-37ae-4236-8c00-c66b5108088f', 'volume_size': 1} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-661683243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d26672-37ae-4236-8c00-c66b5108088f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790546a0d3a046b58e9215994461c75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:22Z,use_quota=True,user_id='388f71af4fa54ef6a78990d1a24fda29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Creating volume d9d26672-37ae-4236-8c00-c66b5108088f {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:22 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:22 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f 1073741824 Apr 15 13:37:22 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:22 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f 1073741824" returned: 0 in 0.501s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:22 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f Apr 15 13:37:22 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Acquiring lock "cinder-29130619-dc86-40d9-b5f1-4f99b95614b5-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Lock "cinder-29130619-dc86-40d9-b5f1-4f99b95614b5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Acquiring lock "cinder-quobyte-29130619-dc86-40d9-b5f1-4f99b95614b5" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Lock "cinder-quobyte-29130619-dc86-40d9-b5f1-4f99b95614b5" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93c1c10-07d6-4b56-8a84-08ea7d373d41]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:23 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f" returned: 0 in 0.503s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afb9cce-5f72-4d11-8fd4-68b3efc3b7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d26672-37ae-4236-8c00-c66b5108088f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5d3df4-9fee-49e6-b3a4-98491e866167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:23 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Volume volume-d9d26672-37ae-4236-8c00-c66b5108088f (d9d26672-37ae-4236-8c00-c66b5108088f): created successfully Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5d3df4-9fee-49e6-b3a4-98491e866167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Flow 'volume_create_manager' (9c53a893-1e80-4e1b-baad-5543def0188d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:23 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-434e506e-8637-480d-bc0f-6fe49e5cea0d tempest-VolumesExtendTest-1768351488 None] Created volume successfully. Apr 15 13:37:23 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5 Apr 15 13:37:23 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:23 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5" returned: 0 in 0.542s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:23 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5 Apr 15 13:37:23 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:24 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29130619-dc86-40d9-b5f1-4f99b95614b5" returned: 0 in 0.468s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Lock "cinder-quobyte-29130619-dc86-40d9-b5f1-4f99b95614b5" released by "delete_volume" :: held 1.038s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Created reservations ['d96386ba-6d92-43cb-ae8c-df03482318c5', 'd014a2ec-f66c-49ee-b842-50388c1e0676', '8124786a-16cf-4320-9818-e9248129e4fa', 'b13c867e-1431-42d4-abaf-4ee3a8d1dc40'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:24 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:24 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Creating offline snapshot ec0e6465-7fcc-467d-bd3f-9d46e06820e7 of volume d9d26672-37ae-4236-8c00-c66b5108088f {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[663dc0f4-3295-483f-bfba-ed693c75f714]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:24 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f Apr 15 13:37:24 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:24 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.510s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:24 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Deleted volume successfully. Apr 15 13:37:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fb7444b8-d265-4c2e-ad1e-bd6f744c063a tempest-VolumesTransfersTest-228008021 None] Lock "cinder-29130619-dc86-40d9-b5f1-4f99b95614b5-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:25 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f" returned: 0 in 0.529s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:25 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 1G Apr 15 13:37:25 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:25 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 1G" returned: 0 in 0.573s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9d26672-37ae-4236-8c00-c66b5108088f -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:25 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9d26672-37ae-4236-8c00-c66b5108088f -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 Apr 15 13:37:25 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:26 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9d26672-37ae-4236-8c00-c66b5108088f -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7" returned: 0 in 0.509s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:26 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 is being set with open permissions: ugo+rw Apr 15 13:37:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:26 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 Apr 15 13:37:26 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:26 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7" returned: 0 in 0.528s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:26 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.info Apr 15 13:37:26 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:27 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.info" returned: 0 in 0.484s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:27 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.info is being set with open permissions: ugo+rw Apr 15 13:37:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:27 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.info Apr 15 13:37:27 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:27 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.info" returned: 0 in 0.549s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.243s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:27 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6343624f-89d7-42df-ae75-9339af364d26 tempest-VolumesExtendTest-1768351488 None] Create snapshot completed successfully Apr 15 13:37:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6b49e131-4f54-40c7-ab0c-6327230e7aef tempest-VolumesExtendTest-1768351488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6b49e131-4f54-40c7-ab0c-6327230e7aef tempest-VolumesExtendTest-1768351488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:28 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[31432358-961b-4a94-b3f0-9f275b841835]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b49e131-4f54-40c7-ab0c-6327230e7aef tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:28 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f Apr 15 13:37:28 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:29 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b49e131-4f54-40c7-ab0c-6327230e7aef tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f" returned: 0 in 0.622s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b49e131-4f54-40c7-ab0c-6327230e7aef tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 2G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b49e131-4f54-40c7-ab0c-6327230e7aef tempest-VolumesExtendTest-1768351488 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 2G" returned: 0 in 0.069s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6b49e131-4f54-40c7-ab0c-6327230e7aef tempest-VolumesExtendTest-1768351488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.714s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:29 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6b49e131-4f54-40c7-ab0c-6327230e7aef tempest-VolumesExtendTest-1768351488 None] Extend volume completed successfully. Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Acquiring lock "cinder-ec0e6465-7fcc-467d-bd3f-9d46e06820e7-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Lock "cinder-ec0e6465-7fcc-467d-bd3f-9d46e06820e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Acquiring lock "cinder-quobyte-d9d26672-37ae-4236-8c00-c66b5108088f" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Lock "cinder-quobyte-d9d26672-37ae-4236-8c00-c66b5108088f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Acquiring lock "cinder-quobyte-ec0e6465-7fcc-467d-bd3f-9d46e06820e7" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Lock "cinder-quobyte-ec0e6465-7fcc-467d-bd3f-9d46e06820e7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Deleting offline snapshot ec0e6465-7fcc-467d-bd3f-9d46e06820e7 of volume d9d26672-37ae-4236-8c00-c66b5108088f {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] snapshot_file for this snap is: volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a9b34-16f9-4a23-8a8e-650f5dc631c7]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:30 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 Apr 15 13:37:30 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:30 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7" returned: 0 in 0.596s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9d26672-37ae-4236-8c00-c66b5108088f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b6e8dc-9dd5-4b50-b255-34615053af2e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:30 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f Apr 15 13:37:30 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:31 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f" returned: 0 in 0.626s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:31 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 Apr 15 13:37:31 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Flow 'volume_create_manager' (161d747a-c4a5-4a9f-b509-3ea9e680ca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14fbb13-627a-4ea4-9069-94a83e462eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14fbb13-627a-4ea4-9069-94a83e462eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-458062608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a89e373-27a8-4d74-adfe-fff983872515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6fe045e9e346f098338a64ca345665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:32Z,use_quota=True,user_id='900efc562134460da79f561a77400f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597015a7-150b-4601-8d4b-ff585e866ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597015a7-150b-4601-8d4b-ff585e866ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596a1356-d562-4dcb-80af-97d608ddfaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596a1356-d562-4dcb-80af-97d608ddfaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a89e373-27a8-4d74-adfe-fff983872515', 'volume_name': 'volume-5a89e373-27a8-4d74-adfe-fff983872515', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17262c57-0cd6-4757-8f3f-b21971cc4efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17262c57-0cd6-4757-8f3f-b21971cc4efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1426a136-211c-4174-a372-f2e95be6215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:31 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Volume 5a89e373-27a8-4d74-adfe-fff983872515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a89e373-27a8-4d74-adfe-fff983872515', 'volume_size': 1} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-458062608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a89e373-27a8-4d74-adfe-fff983872515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6fe045e9e346f098338a64ca345665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:32Z,use_quota=True,user_id='900efc562134460da79f561a77400f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Creating volume 5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:31 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:31 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 1073741824 Apr 15 13:37:31 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:31 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7" returned: 0 in 0.547s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:31 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7 Apr 15 13:37:31 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:32 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f.ec0e6465-7fcc-467d-bd3f-9d46e06820e7" returned: 0 in 0.503s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Lock "cinder-quobyte-ec0e6465-7fcc-467d-bd3f-9d46e06820e7" released by "_delete_snapshot" :: held 2.335s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Lock "cinder-quobyte-d9d26672-37ae-4236-8c00-c66b5108088f" released by "delete_snapshot" :: held 2.347s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Created reservations ['9121f016-04fe-41c7-914b-c5b1c0d3a451', '165b4402-46df-49a6-86c0-8e701ed13cb6', '1eb29024-4e33-4958-8c7c-a6cf057f4a03', '70dba3a4-ab62-41de-9f9a-1a635187a86f'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:32 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 1073741824" returned: 0 in 0.678s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:32 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Delete snapshot completed successfully. Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0d1d5334-bdc7-4bbd-88f7-8f0950025f5c tempest-VolumesExtendTest-1768351488 None] Lock "cinder-ec0e6465-7fcc-467d-bd3f-9d46e06820e7-delete_snapshot" released by "delete_snapshot" :: held 2.452s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:32 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 Apr 15 13:37:32 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:32 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515" returned: 0 in 0.443s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1426a136-211c-4174-a372-f2e95be6215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a89e373-27a8-4d74-adfe-fff983872515', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb488f5-13cc-4bf8-858a-664d937fa206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:32 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Volume volume-5a89e373-27a8-4d74-adfe-fff983872515 (5a89e373-27a8-4d74-adfe-fff983872515): created successfully Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb488f5-13cc-4bf8-858a-664d937fa206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Flow 'volume_create_manager' (161d747a-c4a5-4a9f-b509-3ea9e680ca05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:32 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-27f98a85-fbfd-4a77-aad4-ebd0e0686c97 tempest-VolumesDeleteCascade-386441442 None] Created volume successfully. Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Acquiring lock "cinder-d9d26672-37ae-4236-8c00-c66b5108088f-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Lock "cinder-d9d26672-37ae-4236-8c00-c66b5108088f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Acquiring lock "cinder-quobyte-d9d26672-37ae-4236-8c00-c66b5108088f" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Lock "cinder-quobyte-d9d26672-37ae-4236-8c00-c66b5108088f" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c8b39-0a9f-44fd-a6a6-27b90fe6a184]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:33 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f Apr 15 13:37:33 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG oslo_service.periodic_task [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82595) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:33 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:33 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:33 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f" returned: 0 in 0.603s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:33 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f Apr 15 13:37:33 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.533s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:33 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:33 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Creating offline snapshot 5310e805-f88c-44d2-b253-0da1a38215d5 of volume 5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[72605a01-6e9e-439b-bdb9-e1d2f1fdfb6e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:34 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 Apr 15 13:37:34 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:34 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d9d26672-37ae-4236-8c00-c66b5108088f" returned: 0 in 0.563s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Lock "cinder-quobyte-d9d26672-37ae-4236-8c00-c66b5108088f" released by "delete_volume" :: held 1.195s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Created reservations ['0ae4c554-a88b-4a1d-b53d-a2cfe77b7229', '70040a47-c8de-42df-ab9b-7f7379807b77', 'e060eb17-c170-4728-bb92-cef5b84b360f', '3b147573-9a5f-4159-ad4c-dd6dab52ac84'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:34 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:34 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:34 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515" returned: 0 in 0.606s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:34 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 1G Apr 15 13:37:34 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:34 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.447s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:34 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:34 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Deleted volume successfully. Apr 15 13:37:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5fd22f59-b879-4d9d-bb2c-b974934ce1f9 tempest-VolumesExtendTest-1768351488 None] Lock "cinder-d9d26672-37ae-4236-8c00-c66b5108088f-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:35 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 1G" returned: 0 in 0.537s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a89e373-27a8-4d74-adfe-fff983872515 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:35 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a89e373-27a8-4d74-adfe-fff983872515 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 Apr 15 13:37:35 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:35 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a89e373-27a8-4d74-adfe-fff983872515 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5" returned: 0 in 0.528s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:35 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 is being set with open permissions: ugo+rw Apr 15 13:37:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:35 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 Apr 15 13:37:35 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:36 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5" returned: 0 in 0.533s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:36 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.info Apr 15 13:37:36 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:36 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.info" returned: 0 in 0.567s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:36 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.info is being set with open permissions: ugo+rw Apr 15 13:37:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:36 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.info Apr 15 13:37:36 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:37 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.info" returned: 0 in 0.471s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.299s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:37 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-3dbd9b5a-03c5-407a-9ca8-5badc8ef54b7 tempest-VolumesDeleteCascade-386441442 None] Create snapshot completed successfully Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Flow 'volume_create_manager' (357b91d7-d479-424f-820d-97493d9e37dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3dd9d7-ec78-4b4b-a266-5bfa11030fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3dd9d7-ec78-4b4b-a266-5bfa11030fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1976464441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d33591-33f0-4ae2-a69f-18a162855c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafae430c5774019ac393a7cff178041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:37Z,use_quota=True,user_id='4638543b77b54250830aaad942c8ab43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff39b016-e24f-4dcd-85e9-b77774f275d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff39b016-e24f-4dcd-85e9-b77774f275d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1eb6f1-e175-4656-8e12-c4f380a98333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1eb6f1-e175-4656-8e12-c4f380a98333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d33591-33f0-4ae2-a69f-18a162855c29', 'volume_name': 'volume-52d33591-33f0-4ae2-a69f-18a162855c29', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a99b4f5-2c81-41fc-b410-32440105f8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a99b4f5-2c81-41fc-b410-32440105f8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e393a1-0704-4732-9e3e-fed91a025735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:37 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Volume 52d33591-33f0-4ae2-a69f-18a162855c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d33591-33f0-4ae2-a69f-18a162855c29', 'volume_size': 1} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1976464441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d33591-33f0-4ae2-a69f-18a162855c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafae430c5774019ac393a7cff178041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:37Z,use_quota=True,user_id='4638543b77b54250830aaad942c8ab43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Creating volume 52d33591-33f0-4ae2-a69f-18a162855c29 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:37 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:37 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 1073741824 Apr 15 13:37:37 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:38 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 1073741824" returned: 0 in 0.558s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:38 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 Apr 15 13:37:38 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:38 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29" returned: 0 in 0.439s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.314s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e393a1-0704-4732-9e3e-fed91a025735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d33591-33f0-4ae2-a69f-18a162855c29', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35af46f-51e0-4f73-bc1a-50784e07f23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] Creating offline snapshot a735f38e-64d7-4269-8faf-9e05aaf323d0 of volume 5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:37:38 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Volume volume-52d33591-33f0-4ae2-a69f-18a162855c29 (52d33591-33f0-4ae2-a69f-18a162855c29): created successfully Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35af46f-51e0-4f73-bc1a-50784e07f23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Flow 'volume_create_manager' (357b91d7-d479-424f-820d-97493d9e37dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[911f4d41-d9ad-41f3-a4dc-f3fcab2568f3]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:38 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6d4af180-b9a7-493e-b37e-49e8a483e2c2 tempest-VolumesActionsTest-2063723577 None] Created volume successfully. Apr 15 13:37:38 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 Apr 15 13:37:38 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:38 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Flow 'volume_create_manager' (c35d4d93-633b-4991-8fc7-f1ac1c771057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2ba0cd-239f-47aa-b211-1954797c67ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2ba0cd-239f-47aa-b211-1954797c67ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-971033707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c91260-8a25-40b9-a4d0-50a43356a00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b7209725194ffdb7de5289e4e4d5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:39Z,use_quota=True,user_id='2e609e84f890404bbb0567cee3c16174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29f1d4f-5f16-495e-9d08-7804bd1462f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29f1d4f-5f16-495e-9d08-7804bd1462f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79e0633-147c-4ddd-8523-73ec703c151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79e0633-147c-4ddd-8523-73ec703c151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c91260-8a25-40b9-a4d0-50a43356a00f', 'volume_name': 'volume-f1c91260-8a25-40b9-a4d0-50a43356a00f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da72a85-1c77-4fbb-955b-1346430663d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da72a85-1c77-4fbb-955b-1346430663d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc022c1-62af-4f65-ae1a-0e07070394fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:39 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Volume f1c91260-8a25-40b9-a4d0-50a43356a00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c91260-8a25-40b9-a4d0-50a43356a00f', 'volume_size': 1} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:39 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5" returned: 0 in 0.500s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a89e373-27a8-4d74-adfe-fff983872515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:39 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 1G Apr 15 13:37:39 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:39 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 1G" returned: 0 in 0.561s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:39 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 Apr 15 13:37:39 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:40 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0" returned: 0 in 0.468s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:40 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 is being set with open permissions: ugo+rw Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:40 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 Apr 15 13:37:40 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:40 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0" returned: 0 in 0.483s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-971033707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c91260-8a25-40b9-a4d0-50a43356a00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b7209725194ffdb7de5289e4e4d5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:39Z,use_quota=True,user_id='2e609e84f890404bbb0567cee3c16174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Creating volume f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:40 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:40 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-d989c54d-8f9f-43d8-9c50-1e8cefb4d318 tempest-VolumesDeleteCascade-386441442 None] Create snapshot completed successfully Apr 15 13:37:40 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f 1073741824 Apr 15 13:37:40 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:41 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f 1073741824" returned: 0 in 0.498s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:41 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f Apr 15 13:37:41 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-5a89e373-27a8-4d74-adfe-fff983872515-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-5a89e373-27a8-4d74-adfe-fff983872515-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Performing cascade delete. {{(pid=82595) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-5310e805-f88c-44d2-b253-0da1a38215d5-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-5310e805-f88c-44d2-b253-0da1a38215d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-5a89e373-27a8-4d74-adfe-fff983872515" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-5a89e373-27a8-4d74-adfe-fff983872515" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-5310e805-f88c-44d2-b253-0da1a38215d5" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-5310e805-f88c-44d2-b253-0da1a38215d5" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Deleting offline snapshot 5310e805-f88c-44d2-b253-0da1a38215d5 of volume 5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] snapshot_file for this snap is: volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e09dce3-8364-45fc-8058-3466ce336042]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:41 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 Apr 15 13:37:41 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:41 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f" returned: 0 in 0.449s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc022c1-62af-4f65-ae1a-0e07070394fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c91260-8a25-40b9-a4d0-50a43356a00f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e05429-6d0a-4516-b9d6-a5eb0ae27cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:41 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Volume volume-f1c91260-8a25-40b9-a4d0-50a43356a00f (f1c91260-8a25-40b9-a4d0-50a43356a00f): created successfully Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e05429-6d0a-4516-b9d6-a5eb0ae27cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:41 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Flow 'volume_create_manager' (c35d4d93-633b-4991-8fc7-f1ac1c771057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:41 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0b559850-8be6-48ad-8b8d-54571ffd6d22 tempest-VolumesSnapshotListTestJSON-292052323 None] Created volume successfully. Apr 15 13:37:42 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5" returned: 0 in 0.528s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a89e373-27a8-4d74-adfe-fff983872515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c2625f-50c3-4869-9ef3-3d64c45ce383]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:42 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 Apr 15 13:37:42 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Creating offline snapshot 1ce719f0-7705-4eab-bf04-23d399f910ac of volume f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[b797423b-1e83-44a9-bd04-f00381de97de]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:42 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f Apr 15 13:37:42 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:42 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515" returned: 0 in 0.570s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba269ba-1e8c-425b-8132-a9d9967d5d55]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:42 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 Apr 15 13:37:42 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:42 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f" returned: 0 in 0.515s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:42 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac 1G Apr 15 13:37:42 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:43 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0" returned: 0 in 0.482s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a89e373-27a8-4d74-adfe-fff983872515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84aeb08-22e0-4b12-b1c1-93cad5723f9e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:43 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 Apr 15 13:37:43 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:43 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac 1G" returned: 0 in 0.488s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c91260-8a25-40b9-a4d0-50a43356a00f -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:43 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c91260-8a25-40b9-a4d0-50a43356a00f -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac Apr 15 13:37:43 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:43 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5" returned: 0 in 0.567s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a89e373-27a8-4d74-adfe-fff983872515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a068eae-3796-4353-bd50-570ca0dcb05a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:43 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c91260-8a25-40b9-a4d0-50a43356a00f -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac" returned: 0 in 0.493s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:43 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac is being set with open permissions: ugo+rw Apr 15 13:37:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:43 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac Apr 15 13:37:43 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:43 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 Apr 15 13:37:43 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:44 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac" returned: 0 in 0.398s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:44 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.info Apr 15 13:37:44 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:44 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515" returned: 0 in 0.489s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:44 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 Apr 15 13:37:44 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:44 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.info" returned: 0 in 0.453s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:44 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.info is being set with open permissions: ugo+rw Apr 15 13:37:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:44 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.info Apr 15 13:37:44 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:44 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5" returned: 0 in 0.499s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:44 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5 Apr 15 13:37:44 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:45 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.info" returned: 0 in 0.535s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.944s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:45 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-57815e0b-4c59-4ad6-a3dc-08b17db74559 tempest-VolumesSnapshotListTestJSON-292052323 None] Create snapshot completed successfully Apr 15 13:37:45 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.5310e805-f88c-44d2-b253-0da1a38215d5" returned: 0 in 0.515s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a89e373-27a8-4d74-adfe-fff983872515 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 -F qcow2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:45 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a89e373-27a8-4d74-adfe-fff983872515 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 -F qcow2 Apr 15 13:37:45 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] Creating offline snapshot 5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b of volume f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bebf1e-e2ae-410c-9ead-c7bd223da993]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:45 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac Apr 15 13:37:45 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:45 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a89e373-27a8-4d74-adfe-fff983872515 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 -F qcow2" returned: 0 in 0.544s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-5310e805-f88c-44d2-b253-0da1a38215d5" released by "_delete_snapshot" :: held 4.275s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-5a89e373-27a8-4d74-adfe-fff983872515" released by "delete_snapshot" :: held 4.286s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Created reservations ['54e1210d-d898-4163-b9d8-8beb27eae788', 'f2ee454d-b6c7-48e0-a057-63f7b9fe3185', '6dc65dfa-4fe0-40ab-891a-0febc5e04207', 'a10990e1-7780-4bc7-b4ca-65b17976b75b'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:45 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Delete snapshot completed successfully. Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-5310e805-f88c-44d2-b253-0da1a38215d5-delete_snapshot" released by "delete_snapshot" :: held 4.387s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-a735f38e-64d7-4269-8faf-9e05aaf323d0-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-a735f38e-64d7-4269-8faf-9e05aaf323d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-5a89e373-27a8-4d74-adfe-fff983872515" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-5a89e373-27a8-4d74-adfe-fff983872515" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-a735f38e-64d7-4269-8faf-9e05aaf323d0" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-a735f38e-64d7-4269-8faf-9e05aaf323d0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Deleting offline snapshot a735f38e-64d7-4269-8faf-9e05aaf323d0 of volume 5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] snapshot_file for this snap is: volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[798f8c27-7824-4cce-9d0a-b1a4c66d2584]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:46 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 Apr 15 13:37:46 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:46 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac" returned: 0 in 0.672s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c91260-8a25-40b9-a4d0-50a43356a00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:46 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b 1G Apr 15 13:37:46 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:46 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0" returned: 0 in 0.527s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a89e373-27a8-4d74-adfe-fff983872515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:46 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5803e6-178b-48a1-bf64-429a7a8095ab]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:46 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 Apr 15 13:37:46 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:46 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b 1G" returned: 0 in 0.520s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:46 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b Apr 15 13:37:46 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:47 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515" returned: 0 in 0.563s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:47 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 Apr 15 13:37:47 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:47 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b" returned: 0 in 0.469s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:47 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b is being set with open permissions: ugo+rw Apr 15 13:37:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:47 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b Apr 15 13:37:47 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:47 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0" returned: 0 in 0.496s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:47 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0 Apr 15 13:37:47 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:47 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b" returned: 0 in 0.432s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:47 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-280b9f3a-f46e-4fe6-a5f0-9181d21bbd36 tempest-VolumesSnapshotListTestJSON-292052323 None] Create snapshot completed successfully Apr 15 13:37:48 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515.a735f38e-64d7-4269-8faf-9e05aaf323d0" returned: 0 in 0.436s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-a735f38e-64d7-4269-8faf-9e05aaf323d0" released by "_delete_snapshot" :: held 2.075s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-5a89e373-27a8-4d74-adfe-fff983872515" released by "delete_snapshot" :: held 2.090s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Created reservations ['e8b338df-a097-4a2e-ab04-3b3002a082b2', '86e8351d-bb25-4b43-a2f9-9e2a1c8d60cf', 'e2743614-5459-4ef5-934d-5964ea4f9acd', '62bff902-fe47-4e3e-b24a-29616f00ccbc'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:48 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Delete snapshot completed successfully. Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-a735f38e-64d7-4269-8faf-9e05aaf323d0-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Snapshots deleted, issuing volume delete {{(pid=82595) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-5a89e373-27a8-4d74-adfe-fff983872515" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-5a89e373-27a8-4d74-adfe-fff983872515" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dbc343-cced-4b55-98d0-62d71382c32a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:48 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 Apr 15 13:37:48 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:48 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515" returned: 0 in 0.527s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:48 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515 Apr 15 13:37:48 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] Creating offline snapshot a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 of volume f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[53febca4-81aa-4ad0-8143-73ce539e4b41]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:48 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b Apr 15 13:37:48 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:49 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5a89e373-27a8-4d74-adfe-fff983872515" returned: 0 in 0.449s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-5a89e373-27a8-4d74-adfe-fff983872515" released by "delete_volume" :: held 1.008s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Created reservations ['6422b251-62a0-49a1-9545-2522faf6a9cc', '000cc05b-46c0-4b1a-97dd-727018032ba6', '4179431e-8278-4d95-bef3-0d5deaa3927f', '2ca52939-94b9-4d2b-93b7-fc5178fc6ab5'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:49 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:37:49 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:49 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b" returned: 0 in 0.495s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c91260-8a25-40b9-a4d0-50a43356a00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:49 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 1G Apr 15 13:37:49 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:49 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.467s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:37:49 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Deleted volume successfully. Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9b517e35-3bf5-4dd0-baef-e9a98094063c tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-5a89e373-27a8-4d74-adfe-fff983872515-delete_volume" released by "delete_volume" :: held 8.262s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:49 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 1G" returned: 0 in 0.539s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:49 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 Apr 15 13:37:49 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:50 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4" returned: 0 in 0.451s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:50 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 is being set with open permissions: ugo+rw Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:50 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 Apr 15 13:37:50 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Flow 'volume_create_manager' (198114de-ae4e-446a-963a-7465860b8535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111fcfe8-ed00-4e75-af1f-cb61f0bd89b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111fcfe8-ed00-4e75-af1f-cb61f0bd89b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-287284533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b4af6a-f841-4641-9838-030483f49408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6fe045e9e346f098338a64ca345665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:50Z,use_quota=True,user_id='900efc562134460da79f561a77400f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e90bc8-776f-4640-920f-9026bff4b8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e90bc8-776f-4640-920f-9026bff4b8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67c1c02-9530-417d-b9cf-6f94a4a37b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67c1c02-9530-417d-b9cf-6f94a4a37b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b4af6a-f841-4641-9838-030483f49408', 'volume_name': 'volume-d7b4af6a-f841-4641-9838-030483f49408', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca48c285-24b7-4fb4-bb11-cb1123507f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca48c285-24b7-4fb4-bb11-cb1123507f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c27be28-a300-49f5-a137-b8c715b659f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:50 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Volume d7b4af6a-f841-4641-9838-030483f49408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b4af6a-f841-4641-9838-030483f49408', 'volume_size': 1} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:50 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4" returned: 0 in 0.429s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-287284533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b4af6a-f841-4641-9838-030483f49408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6fe045e9e346f098338a64ca345665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:50Z,use_quota=True,user_id='900efc562134460da79f561a77400f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Creating volume d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:50 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:37:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:50 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 1073741824 Apr 15 13:37:50 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:50 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-8d4cfaef-90ca-4249-85d7-70e017aefd38 tempest-VolumesSnapshotListTestJSON-292052323 None] Create snapshot completed successfully Apr 15 13:37:51 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 1073741824" returned: 0 in 0.766s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:51 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 Apr 15 13:37:51 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-quobyte-a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Deleting offline snapshot a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 of volume f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] snapshot_file for this snap is: volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[047c8ac0-7b48-4961-b19a-615e2bad3116]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:51 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 Apr 15 13:37:51 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:52 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408" returned: 0 in 0.520s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c27be28-a300-49f5-a137-b8c715b659f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b4af6a-f841-4641-9838-030483f49408', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b03de4a-31af-45d0-b639-abbe4c3740f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:52 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Volume volume-d7b4af6a-f841-4641-9838-030483f49408 (d7b4af6a-f841-4641-9838-030483f49408): created successfully Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b03de4a-31af-45d0-b639-abbe4c3740f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Flow 'volume_create_manager' (198114de-ae4e-446a-963a-7465860b8535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:52 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0153d8fa-1ee8-425a-b091-e8e059909355 tempest-VolumesDeleteCascade-386441442 None] Created volume successfully. Apr 15 13:37:52 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4" returned: 0 in 0.547s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c91260-8a25-40b9-a4d0-50a43356a00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e77b77a-a8ca-4f74-9a56-47216c379fea]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:52 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b Apr 15 13:37:52 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Creating offline snapshot cae24e3b-27e7-47ab-9c57-9347a1c0b66d of volume d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8dd68a-0833-49de-ac36-5eb7bd9df36b]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:52 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 Apr 15 13:37:52 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:52 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b" returned: 0 in 0.569s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c91260-8a25-40b9-a4d0-50a43356a00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:52 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 Apr 15 13:37:52 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-279fd900-ffad-4cdf-9ae3-634863190031 tempest-VolumesActionsTest-2063723577 None] Acquiring lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29" by "attach_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-279fd900-ffad-4cdf-9ae3-634863190031 tempest-VolumesActionsTest-2063723577 None] Lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29" acquired by "attach_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:53 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-279fd900-ffad-4cdf-9ae3-634863190031 tempest-VolumesActionsTest-2063723577 None] Attaching volume 52d33591-33f0-4ae2-a69f-18a162855c29 to instance 7ac22d23-ff70-4be2-96e5-ec878b51e1b3 at mountpoint /dev/vdb on host None. Apr 15 13:37:53 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-279fd900-ffad-4cdf-9ae3-634863190031 tempest-VolumesActionsTest-2063723577 None] Attach volume completed successfully. Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-279fd900-ffad-4cdf-9ae3-634863190031 tempest-VolumesActionsTest-2063723577 None] Lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29" released by "attach_volume" :: held 0.055s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:53 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408" returned: 0 in 0.640s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:53 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d 1G Apr 15 13:37:53 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:53 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4" returned: 0 in 0.567s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:53 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4 Apr 15 13:37:53 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7dab6c94-74e7-4875-95b6-ca43d16061b1 tempest-VolumesActionsTest-2063723577 None] Acquiring lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29-detach_volume" by "detach_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7dab6c94-74e7-4875-95b6-ca43d16061b1 tempest-VolumesActionsTest-2063723577 None] Lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:53 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-7dab6c94-74e7-4875-95b6-ca43d16061b1 tempest-VolumesActionsTest-2063723577 None] Detaching volume 52d33591-33f0-4ae2-a69f-18a162855c29 from instance 7ac22d23-ff70-4be2-96e5-ec878b51e1b3. Apr 15 13:37:53 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-7dab6c94-74e7-4875-95b6-ca43d16061b1 tempest-VolumesActionsTest-2063723577 None] Detach volume completed successfully. Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7dab6c94-74e7-4875-95b6-ca43d16061b1 tempest-VolumesActionsTest-2063723577 None] Lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:53 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d 1G" returned: 0 in 0.602s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7b4af6a-f841-4641-9838-030483f49408 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:53 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7b4af6a-f841-4641-9838-030483f49408 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d Apr 15 13:37:53 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:53 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4" returned: 0 in 0.483s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4" released by "_delete_snapshot" :: held 2.235s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" released by "delete_snapshot" :: held 2.252s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:53 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Created reservations ['5b9c4cc8-e097-41cd-bc02-059492d4c6fd', '08dce83a-2558-4269-8737-2ca3ea49c88b', '96b157bc-2636-488d-936e-724b7964ea57', '7a453216-8a9b-4db1-b361-9a0f8b37ab3e'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:54 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Delete snapshot completed successfully. Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2c011fc8-2369-4ad4-afff-e2b66448e291 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-a80a8cf6-a06a-4ec8-a21d-e9e14cae6aa4-delete_snapshot" released by "delete_snapshot" :: held 2.348s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:54 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7b4af6a-f841-4641-9838-030483f49408 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d" returned: 0 in 0.462s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:54 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d is being set with open permissions: ugo+rw Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:54 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d Apr 15 13:37:54 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:54 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d" returned: 0 in 0.442s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:54 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.info Apr 15 13:37:54 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-quobyte-5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Deleting offline snapshot 5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b of volume f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] snapshot_file for this snap is: volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c15e63-db1b-41b7-a083-314cf8d26756]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:54 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b Apr 15 13:37:54 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:55 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.info" returned: 0 in 0.447s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:55 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.info is being set with open permissions: ugo+rw Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:55 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.info Apr 15 13:37:55 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:55 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b" returned: 0 in 0.479s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c91260-8a25-40b9-a4d0-50a43356a00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa44153d-21cd-4a8c-8183-fd51938581af]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:55 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac Apr 15 13:37:55 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:55 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.info" returned: 0 in 0.521s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.199s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:55 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c94db2dc-de73-4149-b028-873b64961593 tempest-VolumesDeleteCascade-386441442 None] Create snapshot completed successfully Apr 15 13:37:55 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac" returned: 0 in 0.609s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c91260-8a25-40b9-a4d0-50a43356a00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:56 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b Apr 15 13:37:56 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:56 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b" returned: 0 in 0.480s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:56 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b Apr 15 13:37:56 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:56 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b" returned: 0 in 0.477s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b" released by "_delete_snapshot" :: held 2.104s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" released by "delete_snapshot" :: held 2.116s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Created reservations ['f59d37bb-0098-404b-8186-f8330edb78f8', '0d0d780b-fdc3-4326-9d16-34cf32fe4dff', '6fc62605-9c59-4de8-9fce-3f4cfb5f0b3c', '339564af-c80d-40e8-bc04-a65c56021251'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:37:57 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Delete snapshot completed successfully. Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-59051d95-2321-462c-8ff4-fc944375445a tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-5e5adb75-f6e2-4d32-a4f2-1b3ad1541c9b-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Flow 'volume_create_manager' (050f298d-b623-4549-af44-244e49de964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15f7624-0067-4c30-b531-7900324891a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15f7624-0067-4c30-b531-7900324891a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-311494081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a5f78e-dfb1-40c6-90da-bd838dba1902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6fe045e9e346f098338a64ca345665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cae24e3b-27e7-47ab-9c57-9347a1c0b66d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:37:57Z,use_quota=True,user_id='900efc562134460da79f561a77400f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83839895-a792-490d-84f2-af0127a90564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83839895-a792-490d-84f2-af0127a90564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e42b8e-5a65-4717-9157-699407b32b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e42b8e-5a65-4717-9157-699407b32b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '29a5f78e-dfb1-40c6-90da-bd838dba1902', 'volume_name': 'volume-29a5f78e-dfb1-40c6-90da-bd838dba1902', 'volume_size': 1, 'snapshot_id': 'cae24e3b-27e7-47ab-9c57-9347a1c0b66d'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f59c52-a5a2-4b34-82a1-7bffc4381614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f59c52-a5a2-4b34-82a1-7bffc4381614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d0da02-de85-4d5d-9a6c-bfdeacb200b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:37:57 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Volume 29a5f78e-dfb1-40c6-90da-bd838dba1902: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-29a5f78e-dfb1-40c6-90da-bd838dba1902', 'volume_size': 1, 'snapshot_id': 'cae24e3b-27e7-47ab-9c57-9347a1c0b66d'} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-cae24e3b-27e7-47ab-9c57-9347a1c0b66d-29a5f78e-dfb1-40c6-90da-bd838dba1902" by "_create_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-cae24e3b-27e7-47ab-9c57-9347a1c0b66d-29a5f78e-dfb1-40c6-90da-bd838dba1902" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Creating volume 29a5f78e-dfb1-40c6-90da-bd838dba1902 from snapshot cae24e3b-27e7-47ab-9c57-9347a1c0b66d {{(pid=82595) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-29a5f78e-dfb1-40c6-90da-bd838dba1902" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-29a5f78e-dfb1-40c6-90da-bd838dba1902" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] snapshot: cae24e3b-27e7-47ab-9c57-9347a1c0b66d, volume: 29a5f78e-dfb1-40c6-90da-bd838dba1902, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83cb61d-11b4-4a35-949a-1f541f19ecca]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:57 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d Apr 15 13:37:57 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:57 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d" returned: 0 in 0.506s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7b4af6a-f841-4641-9838-030483f49408(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d39e6d-7326-4135-b9e9-a0e7036e5787]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:57 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 Apr 15 13:37:57 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-1ce719f0-7705-4eab-bf04-23d399f910ac-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-1ce719f0-7705-4eab-bf04-23d399f910ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-quobyte-1ce719f0-7705-4eab-bf04-23d399f910ac" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-1ce719f0-7705-4eab-bf04-23d399f910ac" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Deleting offline snapshot 1ce719f0-7705-4eab-bf04-23d399f910ac of volume f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] snapshot_file for this snap is: volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[de024f9a-d454-4277-a130-488f87533898]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:58 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac Apr 15 13:37:58 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:58 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408" returned: 0 in 0.514s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:58 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 Apr 15 13:37:58 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:58 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac" returned: 0 in 0.515s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c91260-8a25-40b9-a4d0-50a43356a00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a379cd61-d203-4dd8-a81d-d7dc9542da15]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:37:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:58 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f Apr 15 13:37:58 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:37:59 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 15 13:37:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f" returned: 0 in 1.070s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:37:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:37:59 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac Apr 15 13:37:59 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:00 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902" returned: 0 in 2.190s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:00 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bbcf9a-130c-44d7-9202-8f0dcf73f205]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:00 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac" returned: 0 in 0.868s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:00 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac Apr 15 13:38:00 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:00 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 Apr 15 13:38:00 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:00 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f.1ce719f0-7705-4eab-bf04-23d399f910ac" returned: 0 in 0.492s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-1ce719f0-7705-4eab-bf04-23d399f910ac" released by "_delete_snapshot" :: held 3.018s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" released by "delete_snapshot" :: held 3.030s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Created reservations ['1b088277-0832-4adc-b1ab-2bacb117b14a', 'fe5386cc-4cd9-4d44-9c54-0cae977024bd', 'bea05cde-fbd5-40af-bbe2-12ed338b8b70', '490c96d6-6d96-4927-b0b3-ad074e57967b'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:01 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Delete snapshot completed successfully. Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-40eedeaa-6fe6-4395-88d6-9ea39df29562 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-1ce719f0-7705-4eab-bf04-23d399f910ac-delete_snapshot" released by "delete_snapshot" :: held 3.138s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:01 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408" returned: 0 in 0.767s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:38:01 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Converted 1024.00 MB image at 467.28 MB/s Apr 15 13:38:01 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 is being set with open permissions: ugo+rw Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:01 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 Apr 15 13:38:01 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:01 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902" returned: 0 in 0.453s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-29a5f78e-dfb1-40c6-90da-bd838dba1902" released by "_copy_volume_from_snapshot" :: held 4.482s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-cae24e3b-27e7-47ab-9c57-9347a1c0b66d-29a5f78e-dfb1-40c6-90da-bd838dba1902" released by "_create_volume_from_snapshot" :: held 4.498s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.506s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d0da02-de85-4d5d-9a6c-bfdeacb200b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a5f78e-dfb1-40c6-90da-bd838dba1902', 'volume_size': 1, 'snapshot_id': 'cae24e3b-27e7-47ab-9c57-9347a1c0b66d'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae60efa-907a-4df3-9c5e-470265348f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:01 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Volume volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 (29a5f78e-dfb1-40c6-90da-bd838dba1902): created successfully Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae60efa-907a-4df3-9c5e-470265348f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Flow 'volume_create_manager' (050f298d-b623-4549-af44-244e49de964b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:01 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-753684fb-df77-401a-9966-bfc1ddcbfb34 tempest-VolumesDeleteCascade-386441442 None] Created volume successfully. Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-f1c91260-8a25-40b9-a4d0-50a43356a00f-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-f1c91260-8a25-40b9-a4d0-50a43356a00f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5088a22-a56b-4f91-8960-f4cd05da513a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:02 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f Apr 15 13:38:02 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-d7b4af6a-f841-4641-9838-030483f49408-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-d7b4af6a-f841-4641-9838-030483f49408-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Performing cascade delete. {{(pid=82595) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-cae24e3b-27e7-47ab-9c57-9347a1c0b66d-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-cae24e3b-27e7-47ab-9c57-9347a1c0b66d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-d7b4af6a-f841-4641-9838-030483f49408" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-d7b4af6a-f841-4641-9838-030483f49408" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-cae24e3b-27e7-47ab-9c57-9347a1c0b66d" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-cae24e3b-27e7-47ab-9c57-9347a1c0b66d" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Deleting offline snapshot cae24e3b-27e7-47ab-9c57-9347a1c0b66d of volume d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] snapshot_file for this snap is: volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[db63df5b-501f-4541-84f0-f702bf277715]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:02 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d Apr 15 13:38:02 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:02 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f" returned: 0 in 0.519s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:02 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f Apr 15 13:38:02 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:03 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d" returned: 0 in 0.484s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7b4af6a-f841-4641-9838-030483f49408(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[3312448b-ed86-4c33-acdf-8af425eb36e9]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:03 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 Apr 15 13:38:03 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:03 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-f1c91260-8a25-40b9-a4d0-50a43356a00f" returned: 0 in 0.417s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-quobyte-f1c91260-8a25-40b9-a4d0-50a43356a00f" released by "delete_volume" :: held 0.974s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Created reservations ['0763335c-88fd-4892-a629-322341977d8b', '3db1d296-c74a-481d-beac-426e10fff060', '86cba6db-fafb-429e-914f-5dac434803f0', '32c0d46c-2bc8-4d04-935b-50430c7a802c'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:03 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:03 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:03 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408" returned: 0 in 0.534s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:03 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d Apr 15 13:38:03 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:03 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.517s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:03 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Deleted volume successfully. Apr 15 13:38:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d274d4af-35fc-4bcc-b753-85ba5dfaa216 tempest-VolumesSnapshotListTestJSON-292052323 None] Lock "cinder-f1c91260-8a25-40b9-a4d0-50a43356a00f-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:04 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d" returned: 0 in 0.521s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:04 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d Apr 15 13:38:04 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:04 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408.cae24e3b-27e7-47ab-9c57-9347a1c0b66d" returned: 0 in 0.460s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-cae24e3b-27e7-47ab-9c57-9347a1c0b66d" released by "_delete_snapshot" :: held 2.055s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-d7b4af6a-f841-4641-9838-030483f49408" released by "delete_snapshot" :: held 2.065s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=144,cinder:INSERT=48,cinder:UPDATE=173,cinder:DELETE=12 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:UPDATE=166,cinder:SELECT=155,cinder:INSERT=48,cinder:DELETE=17 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Created reservations ['45f0c83a-d586-4550-976c-119c1a392b4b', '1d208272-0fc7-4cda-9dd3-b51486b3eb6a', 'eb5cd6a1-2787-40a5-8ede-7d5c2d2b6899', 'dfcff6dc-280f-4716-ab82-7156c0346c08'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:04 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Delete snapshot completed successfully. Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-cae24e3b-27e7-47ab-9c57-9347a1c0b66d-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Snapshots deleted, issuing volume delete {{(pid=82595) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-d7b4af6a-f841-4641-9838-030483f49408" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-d7b4af6a-f841-4641-9838-030483f49408" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba7a83-4589-40e7-8434-35cb20e79aba]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:04 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 Apr 15 13:38:04 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Flow 'volume_create_manager' (44ee1a62-1265-4424-8665-219efade839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73c06ae-9518-4a07-9829-0b48d0b153e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73c06ae-9518-4a07-9829-0b48d0b153e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90659c95-e071-437e-9981-90553e092c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fef85168ef43a58ae2075e00b7c9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:05Z,use_quota=True,user_id='13da26ed317c4e54baa1574faa838260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06fb51b-dca6-4d84-a444-16f92e15a2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06fb51b-dca6-4d84-a444-16f92e15a2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120b230c-564d-46ba-a9e2-92240e8f492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120b230c-564d-46ba-a9e2-92240e8f492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90659c95-e071-437e-9981-90553e092c48', 'volume_name': 'volume-90659c95-e071-437e-9981-90553e092c48', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b260d3-9121-4943-8261-64873c4c8202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b260d3-9121-4943-8261-64873c4c8202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc8f4f5-6347-4c26-b13b-0688e090f8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:05 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Volume 90659c95-e071-437e-9981-90553e092c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90659c95-e071-437e-9981-90553e092c48', 'volume_size': 1} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90659c95-e071-437e-9981-90553e092c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fef85168ef43a58ae2075e00b7c9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:05Z,use_quota=True,user_id='13da26ed317c4e54baa1574faa838260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Creating volume 90659c95-e071-437e-9981-90553e092c48 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:38:05 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:05 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48 1073741824 Apr 15 13:38:05 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:05 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408" returned: 0 in 0.537s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:05 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408 Apr 15 13:38:05 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:05 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48 1073741824" returned: 0 in 0.528s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:05 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48 Apr 15 13:38:05 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:05 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7b4af6a-f841-4641-9838-030483f49408" returned: 0 in 0.478s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-d7b4af6a-f841-4641-9838-030483f49408" released by "delete_volume" :: held 1.083s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Created reservations ['f28ae8d2-4959-454c-bce8-9f05e0200651', '55537816-1e81-4205-9974-2b9452424bd8', '0f4e0345-b48d-499c-8239-a83045e06103', 'd347c60b-9cdc-4e24-96d9-69c91b50d69b'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:05 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:05 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:06 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48" returned: 0 in 0.495s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc8f4f5-6347-4c26-b13b-0688e090f8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90659c95-e071-437e-9981-90553e092c48', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784ef04b-24ec-469e-8b23-688e26fc1459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:06 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Volume volume-90659c95-e071-437e-9981-90553e092c48 (90659c95-e071-437e-9981-90553e092c48): created successfully Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784ef04b-24ec-469e-8b23-688e26fc1459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Flow 'volume_create_manager' (44ee1a62-1265-4424-8665-219efade839f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:06 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-96f41496-4b6e-4d76-8c66-6c35972b4ae9 tempest-CinderUnicodeTest-1472318802 None] Created volume successfully. Apr 15 13:38:06 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.457s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:06 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Deleted volume successfully. Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f21f7f09-d755-4da0-b12d-f6175c8c6701 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-d7b4af6a-f841-4641-9838-030483f49408-delete_volume" released by "delete_volume" :: held 3.852s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-29a5f78e-dfb1-40c6-90da-bd838dba1902-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-29a5f78e-dfb1-40c6-90da-bd838dba1902-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "cinder-quobyte-29a5f78e-dfb1-40c6-90da-bd838dba1902" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-29a5f78e-dfb1-40c6-90da-bd838dba1902" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[db663d77-ecd8-42e6-a9c8-3af1b0479a6f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:07 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 Apr 15 13:38:07 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:07 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902" returned: 0 in 0.517s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:07 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902 Apr 15 13:38:07 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Flow 'volume_create_manager' (c2e07037-fd99-4663-afc6-b11dec5854d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f74845-4768-40c0-847e-11b1e2094846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f74845-4768-40c0-847e-11b1e2094846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-872281547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b979b3-7f25-487c-9e69-5aa592936ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fef85168ef43a58ae2075e00b7c9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:08Z,use_quota=True,user_id='13da26ed317c4e54baa1574faa838260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9075223-d023-4051-a8d0-9f19ca3f6718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9075223-d023-4051-a8d0-9f19ca3f6718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7efb04f6-fa9b-4cc8-a84d-09f8432e4ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7efb04f6-fa9b-4cc8-a84d-09f8432e4ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2b979b3-7f25-487c-9e69-5aa592936ae2', 'volume_name': 'volume-a2b979b3-7f25-487c-9e69-5aa592936ae2', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f637f3e-0731-46af-9ead-e41e1c9dd040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f637f3e-0731-46af-9ead-e41e1c9dd040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5c2163-9d2e-48ee-94d0-b522413a8326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:07 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Volume a2b979b3-7f25-487c-9e69-5aa592936ae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2b979b3-7f25-487c-9e69-5aa592936ae2', 'volume_size': 1} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-872281547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b979b3-7f25-487c-9e69-5aa592936ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fef85168ef43a58ae2075e00b7c9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:08Z,use_quota=True,user_id='13da26ed317c4e54baa1574faa838260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Creating volume a2b979b3-7f25-487c-9e69-5aa592936ae2 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:38:07 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:07 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 1073741824 Apr 15 13:38:07 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:07 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-29a5f78e-dfb1-40c6-90da-bd838dba1902" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-quobyte-29a5f78e-dfb1-40c6-90da-bd838dba1902" released by "delete_volume" :: held 1.019s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Created reservations ['0f7f5006-c17c-443a-b832-b66972899047', '5a6b142d-ad9e-4011-88fb-ddf6e813d505', 'be626a9d-9ccd-4792-b88b-904491771871', '9ffb8610-d580-460b-b927-439f586d627a'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:08 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:08 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:08 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 1073741824" returned: 0 in 0.535s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:08 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 Apr 15 13:38:08 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:08 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.404s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:08 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Deleted volume successfully. Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d8fbcde7-37bc-4c97-a899-c2ccebcf4a00 tempest-VolumesDeleteCascade-386441442 None] Lock "cinder-29a5f78e-dfb1-40c6-90da-bd838dba1902-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:08 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2" returned: 0 in 0.435s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5c2163-9d2e-48ee-94d0-b522413a8326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b979b3-7f25-487c-9e69-5aa592936ae2', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2db1c7-6c53-43e3-adc8-3db70c028f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:08 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Volume volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 (a2b979b3-7f25-487c-9e69-5aa592936ae2): created successfully Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2db1c7-6c53-43e3-adc8-3db70c028f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:08 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Flow 'volume_create_manager' (c2e07037-fd99-4663-afc6-b11dec5854d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:08 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b872d41d-e3ab-45e2-9e6e-c060561f1a96 tempest-CinderUnicodeTest-1472318802 None] Created volume successfully. Apr 15 13:38:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Creating offline snapshot 02f26adf-8fb2-4f71-8c2e-5bed004aa214 of volume a2b979b3-7f25-487c-9e69-5aa592936ae2 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:38:09 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb7e223-4f55-4e47-86e6-a4937fd313ef]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:09 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 Apr 15 13:38:09 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:10 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2" returned: 0 in 0.622s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:10 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 1G Apr 15 13:38:10 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (3512f5fb-1e2b-45cb-a8bd-c316b28085cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89490b97-4d27-4c7f-87d5-11988d0fe8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89490b97-4d27-4c7f-87d5-11988d0fe8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2073951585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f49d595-2dc0-46fb-82b7-87c7e7fd3d66,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:11Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12c2b14-edda-4c13-8c2d-f54a38dfd8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12c2b14-edda-4c13-8c2d-f54a38dfd8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11d4101-584e-4887-a5a2-ee6d7a047c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11d4101-584e-4887-a5a2-ee6d7a047c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f49d595-2dc0-46fb-82b7-87c7e7fd3d66', 'volume_name': 'volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fdfbf0-5b4a-47e9-9bd9-6b3f4d4d4551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fdfbf0-5b4a-47e9-9bd9-6b3f4d4d4551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e64641-5291-4773-89b6-229355aa7a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:11 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Volume 5f49d595-2dc0-46fb-82b7-87c7e7fd3d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66', 'volume_size': 1} Apr 15 13:38:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:11 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 1G" returned: 0 in 0.543s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:11 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 Apr 15 13:38:11 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:11 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214" returned: 0 in 0.599s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:11 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 is being set with open permissions: ugo+rw Apr 15 13:38:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:11 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 Apr 15 13:38:11 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:12 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214" returned: 0 in 0.529s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:12 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.info Apr 15 13:38:12 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:12 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.info" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:12 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.info is being set with open permissions: ugo+rw Apr 15 13:38:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:12 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.info Apr 15 13:38:12 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:13 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.info" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.301s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.193s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2073951585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f49d595-2dc0-46fb-82b7-87c7e7fd3d66,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:11Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Creating volume 5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:38:13 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:13 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-77483861-bea9-4eb8-be8e-c8538c4f6d0a tempest-CinderUnicodeTest-1472318802 None] Create snapshot completed successfully Apr 15 13:38:13 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 1073741824 Apr 15 13:38:13 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:13 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 1073741824" returned: 0 in 0.546s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:13 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 Apr 15 13:38:13 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-51e718b8-2fdd-4a29-b466-1c1f1bf6d4e8 tempest-VolumesActionsTest-2063723577 None] Acquiring lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29" by "attach_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-51e718b8-2fdd-4a29-b466-1c1f1bf6d4e8 tempest-VolumesActionsTest-2063723577 None] Lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29" acquired by "attach_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:13 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-51e718b8-2fdd-4a29-b466-1c1f1bf6d4e8 tempest-VolumesActionsTest-2063723577 None] Attaching volume 52d33591-33f0-4ae2-a69f-18a162855c29 to instance 09151028-1de8-4028-ac1f-87ad4eb72571 at mountpoint /dev/vdb on host None. Apr 15 13:38:13 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-51e718b8-2fdd-4a29-b466-1c1f1bf6d4e8 tempest-VolumesActionsTest-2063723577 None] Attach volume completed successfully. Apr 15 13:38:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-51e718b8-2fdd-4a29-b466-1c1f1bf6d4e8 tempest-VolumesActionsTest-2063723577 None] Lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29" released by "attach_volume" :: held 0.059s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "cinder-02f26adf-8fb2-4f71-8c2e-5bed004aa214-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-02f26adf-8fb2-4f71-8c2e-5bed004aa214-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "cinder-quobyte-a2b979b3-7f25-487c-9e69-5aa592936ae2" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-quobyte-a2b979b3-7f25-487c-9e69-5aa592936ae2" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "cinder-quobyte-02f26adf-8fb2-4f71-8c2e-5bed004aa214" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-quobyte-02f26adf-8fb2-4f71-8c2e-5bed004aa214" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Deleting offline snapshot 02f26adf-8fb2-4f71-8c2e-5bed004aa214 of volume a2b979b3-7f25-487c-9e69-5aa592936ae2 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] snapshot_file for this snap is: volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafe9b4b-54f3-4999-9d81-3a797dc50b7c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:14 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 Apr 15 13:38:14 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:14 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66" returned: 0 in 0.448s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e64641-5291-4773-89b6-229355aa7a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daa6c72-6afb-44c2-b124-7cb85ca383ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:14 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Volume volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 (5f49d595-2dc0-46fb-82b7-87c7e7fd3d66): created successfully Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daa6c72-6afb-44c2-b124-7cb85ca383ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (3512f5fb-1e2b-45cb-a8bd-c316b28085cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:14 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-fd9e70d5-9cbd-44e5-a6d6-8e9b6cbf78b7 tempest-VolumesGetTest-1401439631 None] Created volume successfully. Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4f95d9d6-672e-4578-a3de-c6bd4eeb2961 tempest-VolumesActionsTest-2063723577 None] Acquiring lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29-detach_volume" by "detach_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4f95d9d6-672e-4578-a3de-c6bd4eeb2961 tempest-VolumesActionsTest-2063723577 None] Lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:14 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-4f95d9d6-672e-4578-a3de-c6bd4eeb2961 tempest-VolumesActionsTest-2063723577 None] Detaching volume 52d33591-33f0-4ae2-a69f-18a162855c29 from instance 09151028-1de8-4028-ac1f-87ad4eb72571. Apr 15 13:38:14 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-4f95d9d6-672e-4578-a3de-c6bd4eeb2961 tempest-VolumesActionsTest-2063723577 None] Detach volume completed successfully. Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4f95d9d6-672e-4578-a3de-c6bd4eeb2961 tempest-VolumesActionsTest-2063723577 None] Lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:14 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214" returned: 0 in 0.521s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2b979b3-7f25-487c-9e69-5aa592936ae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79443e4-d1a0-4dc0-9e7a-49a22ef62142]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:14 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 Apr 15 13:38:14 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:15 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2" returned: 0 in 0.642s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:15 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 Apr 15 13:38:15 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (a6a772de-4146-438f-a917-f145cc7d0630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0544fda0-d0d2-4d1b-bbde-159057a1e5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0544fda0-d0d2-4d1b-bbde-159057a1e5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1865420121',display_name='tempest-VolumesGetTest-Volume-1826272409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdec00d-bd75-4cc0-9f9f-7e50c02ac114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:16Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccef4641-d602-4aba-8c33-18d255354624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccef4641-d602-4aba-8c33-18d255354624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0e0acd-aba0-4bc2-8a16-2013c4b09c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0e0acd-aba0-4bc2-8a16-2013c4b09c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cdec00d-bd75-4cc0-9f9f-7e50c02ac114', 'volume_name': 'volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da46b989-62ae-4221-b31f-7976e30982b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da46b989-62ae-4221-b31f-7976e30982b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f01c5e-c374-4ce0-85fd-4e329e5f68f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:15 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Volume 2cdec00d-bd75-4cc0-9f9f-7e50c02ac114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114', 'volume_size': 1} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1865420121',display_name='tempest-VolumesGetTest-Volume-1826272409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdec00d-bd75-4cc0-9f9f-7e50c02ac114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:16Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Creating volume 2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:38:15 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:15 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 1073741824 Apr 15 13:38:15 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:15 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214" returned: 0 in 0.576s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:15 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214 Apr 15 13:38:15 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:16 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 1073741824" returned: 0 in 0.608s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:16 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2.02f26adf-8fb2-4f71-8c2e-5bed004aa214" returned: 0 in 0.529s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:16 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 Apr 15 13:38:16 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-quobyte-02f26adf-8fb2-4f71-8c2e-5bed004aa214" released by "_delete_snapshot" :: held 2.364s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-quobyte-a2b979b3-7f25-487c-9e69-5aa592936ae2" released by "delete_snapshot" :: held 2.387s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Created reservations ['a2475b47-f353-4c19-a11e-53977a1e04ea', '2e6f60f2-ce6c-4c9f-b9a0-10b69a541d74', '472b6183-eae6-4dd6-9d75-3368e378c2f1', '400d92d0-36a0-4216-88a7-3be0491c1f3e'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:16 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Delete snapshot completed successfully. Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6790a0d1-80b7-40dc-a2ac-462f4eca42cd tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-02f26adf-8fb2-4f71-8c2e-5bed004aa214-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:16 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114" returned: 0 in 0.574s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f01c5e-c374-4ce0-85fd-4e329e5f68f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459c0745-29e8-4620-9cb7-0e4c3568acca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:16 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Volume volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 (2cdec00d-bd75-4cc0-9f9f-7e50c02ac114): created successfully Apr 15 13:38:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459c0745-29e8-4620-9cb7-0e4c3568acca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (a6a772de-4146-438f-a917-f145cc7d0630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:17 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-3b19c4cb-c82d-47e6-8d51-be4c6e13bd07 tempest-VolumesGetTest-1401439631 None] Created volume successfully. Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "cinder-a2b979b3-7f25-487c-9e69-5aa592936ae2-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-a2b979b3-7f25-487c-9e69-5aa592936ae2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "cinder-quobyte-a2b979b3-7f25-487c-9e69-5aa592936ae2" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-quobyte-a2b979b3-7f25-487c-9e69-5aa592936ae2" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee5f0e0-d3bf-444e-b7dc-5add70a6ffa3]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:17 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 Apr 15 13:38:17 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:17 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2" returned: 0 in 0.551s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Lock "cinder-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:17 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2 Apr 15 13:38:17 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-quobyte-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ec74ba-4483-48f1-86cc-ddd44bae37d9]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:18 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 Apr 15 13:38:18 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:18 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a2b979b3-7f25-487c-9e69-5aa592936ae2" returned: 0 in 0.430s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-quobyte-a2b979b3-7f25-487c-9e69-5aa592936ae2" released by "delete_volume" :: held 1.012s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Created reservations ['e69027b9-7828-45c0-94f3-9d2c98da4d13', '46a96ce5-b88b-44cc-81ac-376f63d22c52', '0f579b07-3d08-4641-9c5e-e69d90cb2d15', 'd6c885d6-0a98-4463-98f5-6799dbc43352'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:18 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:18 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:18 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114" returned: 0 in 0.508s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:18 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114 Apr 15 13:38:18 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:18 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.395s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:18 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Deleted volume successfully. Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-f80217e0-8c2e-4838-b145-09cf43cc7626 tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-a2b979b3-7f25-487c-9e69-5aa592936ae2-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:18 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114" returned: 0 in 0.401s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114" released by "delete_volume" :: held 0.936s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:18 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Created reservations ['2d877860-85ac-40f3-94e1-53edf4095a26', '2d8966d5-686c-495f-9470-7c7ed5ab06fc', 'c1a6c7e5-784f-4062-9ff2-530c0672dec2', '3f1e5c22-41b6-4ce3-877f-47ddbafc1142'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:19 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:19 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Lock "cinder-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-quobyte-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66" acquired by "delete_volume" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[080f211f-9a8f-47c4-9d08-25df8dde961c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:19 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 Apr 15 13:38:19 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:19 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.437s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:19 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Deleted volume successfully. Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5d798a95-9e37-4433-b0b0-4716de8b0234 tempest-VolumesGetTest-1401439631 None] Lock "cinder-2cdec00d-bd75-4cc0-9f9f-7e50c02ac114-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "cinder-90659c95-e071-437e-9981-90553e092c48-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-90659c95-e071-437e-9981-90553e092c48-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "cinder-quobyte-90659c95-e071-437e-9981-90553e092c48" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-quobyte-90659c95-e071-437e-9981-90553e092c48" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f7e721-7541-4f05-88fe-a851495cef18]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:19 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48 Apr 15 13:38:19 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:19 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66" returned: 0 in 0.507s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:19 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66 Apr 15 13:38:19 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:20 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48" returned: 0 in 0.488s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:20 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66" returned: 0 in 0.416s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:20 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48 Apr 15 13:38:20 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66" released by "delete_volume" :: held 0.944s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Created reservations ['f0641432-215e-4ba3-a3e9-2bfd24d5771a', '6fb92169-b38f-44c7-a427-0dc8828184c3', 'b15d0e60-fd4a-4f39-984a-9c0c7955f4b0', 'b399d708-530a-415b-9449-6ef9e2369ff1'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:20 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:20 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (7e69645e-f089-4404-88f0-189586a61efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51329aa3-86bc-40a0-97a2-534f61cc5388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51329aa3-86bc-40a0-97a2-534f61cc5388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1603006427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:20Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba9815a-3ff4-4f7b-8938-24d53c9e96af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba9815a-3ff4-4f7b-8938-24d53c9e96af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c149ca8a-3e64-4cd0-9940-523b13c7255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c149ca8a-3e64-4cd0-9940-523b13c7255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c', 'volume_name': 'volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56344b54-15bc-4c44-be7d-4905e01d5315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56344b54-15bc-4c44-be7d-4905e01d5315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8168a226-2f75-4348-8bb3-53f5aa91abcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:20 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Volume 1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c', 'volume_size': 1} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1603006427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:20Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Creating volume 1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:38:20 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:20 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-90659c95-e071-437e-9981-90553e092c48" returned: 0 in 0.499s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:20 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c 1073741824 Apr 15 13:38:20 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-quobyte-90659c95-e071-437e-9981-90553e092c48" released by "delete_volume" :: held 1.017s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Created reservations ['348e03be-9fb4-4978-b3ed-8787fa14c98b', 'be5bf2a6-1866-4528-aa1b-0a0dec673400', 'a39a6fb4-bdca-49f3-b10a-0c1a146a2a62', '94817b9d-1810-4864-8637-891eb57bb045'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:20 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:20 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Deleted volume successfully. Apr 15 13:38:20 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:20 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a2500694-3eb1-4f84-92c7-224ea19344f9 tempest-VolumesGetTest-1401439631 None] Lock "cinder-5f49d595-2dc0-46fb-82b7-87c7e7fd3d66-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:21 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c 1073741824" returned: 0 in 0.495s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:21 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.427s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Deleted volume successfully. Apr 15 13:38:21 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c Apr 15 13:38:21 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-fa911bb9-7d80-4d0e-893d-110f87675742 tempest-CinderUnicodeTest-1472318802 None] Lock "cinder-90659c95-e071-437e-9981-90553e092c48-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:21 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c" returned: 0 in 0.465s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8168a226-2f75-4348-8bb3-53f5aa91abcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb8d80f-37d6-4ddb-98a1-5fa54554b9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Volume volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c (1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c): created successfully Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb8d80f-37d6-4ddb-98a1-5fa54554b9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (7e69645e-f089-4404-88f0-189586a61efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c0afc254-8d82-45f2-9887-0e50215cd8d1 tempest-VolumesGetTest-1401439631 None] Created volume successfully. Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38e5eec-abfb-4931-a926-77ab7438be09]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:22 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 Apr 15 13:38:22 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:38:22 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (e865a774-5027-4e9b-9c5f-2bb3c76485d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c74c431-759a-47da-8d04-18e2521b50c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29" returned: 0 in 0.594s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f7172d-96c6-41cf-ab35-5fc599d84cba]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c74c431-759a-47da-8d04-18e2521b50c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-467871599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144e8250-6d62-443c-ad0d-f05311cea4bb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:23Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db1f1e0-0030-412c-b932-f5990a7ad78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db1f1e0-0030-412c-b932-f5990a7ad78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e9d8f9-96c4-4b0a-960a-e28d81121e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e9d8f9-96c4-4b0a-960a-e28d81121e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '144e8250-6d62-443c-ad0d-f05311cea4bb', 'volume_name': 'volume-144e8250-6d62-443c-ad0d-f05311cea4bb', 'volume_size': 1, 'source_volid': '1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c', 'source_volstatus': 'available'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fdb7a4-1154-4082-8d43-3ea5a34024b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fdb7a4-1154-4082-8d43-3ea5a34024b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25ccb48-6551-4fef-8348-94b888a84efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:23 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Volume 144e8250-6d62-443c-ad0d-f05311cea4bb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-144e8250-6d62-443c-ad0d-f05311cea4bb', 'volume_size': 1, 'source_volid': '1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c', 'source_volstatus': 'available'} Apr 15 13:38:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:23 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 Apr 15 13:38:23 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:23 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29" returned: 0 in 0.518s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.3392ab68-b95c-422c-99a5-5ac54bd84928ys_bqbfi.img {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:23 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.3392ab68-b95c-422c-99a5-5ac54bd84928ys_bqbfi.img Apr 15 13:38:23 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:25 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.3392ab68-b95c-422c-99a5-5ac54bd84928ys_bqbfi.img" returned: 0 in 2.026s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:25 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce256d01-4b57-4728-952e-7886ed925d99]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:25 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 Apr 15 13:38:25 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:26 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29" returned: 0 in 0.705s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:26 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.3392ab68-b95c-422c-99a5-5ac54bd84928ys_bqbfi.img {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:38:26 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Converted 1024.00 MB image at 505.00 MB/s Apr 15 13:38:26 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] 3392ab68-b95c-422c-99a5-5ac54bd84928 was raw, no need to convert to raw {{(pid=82595) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 15 13:38:33 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=57,cinder:INSERT=21,cinder:UPDATE=82,cinder:DELETE=8 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:38:33 devstack cinder-volume[82595]: DEBUG oslo_service.periodic_task [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82595) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:38:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:33 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:33 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:33 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.549s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:33 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:36 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:INSERT=19,cinder:UPDATE=75,cinder:SELECT=66,cinder:DELETE=4 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:38:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.302s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Uploaded volume to glance image-id: 3392ab68-b95c-422c-99a5-5ac54bd84928. {{(pid=82595) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 13:38:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.627s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:36 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Cloning volume 1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c to volume 144e8250-6d62-443c-ad0d-f05311cea4bb Apr 15 13:38:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Creating offline snapshot 8941ecea-8238-4c81-9f91-26ab5a98fbf1 of volume 1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:38:36 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-f8a34ae9-b57e-498e-8148-ea31d4f0f019 tempest-VolumesActionsTest-2063723577 None] Copy volume to image completed successfully. Apr 15 13:38:36 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c944312b-56b6-4ad1-982d-d217960ec0bd]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:36 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c Apr 15 13:38:36 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:37 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c" returned: 0 in 0.565s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:37 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 1G Apr 15 13:38:37 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Flow 'volume_create_manager' (22a6000b-3475-450d-994c-7e1e14ef5827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffb0690-5543-4421-a906-1ef9fd685857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffb0690-5543-4421-a906-1ef9fd685857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1633320319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd02c74-49af-4576-9f7d-e8ea2e7d76a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0279804594f2441d82d232131f3e6153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:38Z,use_quota=True,user_id='768208327e944ac9919277c25ab68797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5731fb0e-b2f0-48c3-8261-efd0c1bc1272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5731fb0e-b2f0-48c3-8261-efd0c1bc1272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d3f98b-b155-4008-afd7-f3c7c415a72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d3f98b-b155-4008-afd7-f3c7c415a72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd02c74-49af-4576-9f7d-e8ea2e7d76a4', 'volume_name': 'volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8b3fcd-5faa-4fb1-a9ba-828131d796a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8b3fcd-5faa-4fb1-a9ba-828131d796a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c8fa94-dba3-4cc8-bf3c-37ecf920d024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:37 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Volume 4cd02c74-49af-4576-9f7d-e8ea2e7d76a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4', 'volume_size': 1} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:37 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 1G" returned: 0 in 0.522s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:37 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 Apr 15 13:38:37 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:38 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1" returned: 0 in 0.432s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:38 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 is being set with open permissions: ugo+rw Apr 15 13:38:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:38 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 Apr 15 13:38:38 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:38 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1" returned: 0 in 0.441s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:38 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.info Apr 15 13:38:38 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:39 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.info" returned: 0 in 0.428s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:39 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.info is being set with open permissions: ugo+rw Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:39 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.info Apr 15 13:38:39 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:39 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.info" returned: 0 in 0.424s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-quobyte-144e8250-6d62-443c-ad0d-f05311cea4bb" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-144e8250-6d62-443c-ad0d-f05311cea4bb" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] snapshot: 8941ecea-8238-4c81-9f91-26ab5a98fbf1, volume: 144e8250-6d62-443c-ad0d-f05311cea4bb, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b275aee-c9cf-46b0-ad6e-81c141caf092]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:39 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 Apr 15 13:38:39 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:40 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1" returned: 0 in 0.482s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:38:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:38:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:38:40 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f229b0e-3d8c-457e-9c20-c30cb2a3d3d3]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:40 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c Apr 15 13:38:40 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:40 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c" returned: 0 in 0.482s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:40 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:38:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:40 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb Apr 15 13:38:40 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:42 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb" returned: 0 in 2.283s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:42 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a965548-0168-47d5-896b-cfbfcf01807c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:42 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c Apr 15 13:38:42 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:43 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c" returned: 0 in 0.626s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:38:43 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Converted 1024.00 MB image at 448.24 MB/s Apr 15 13:38:43 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb is being set with open permissions: ugo+rw Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:43 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb Apr 15 13:38:43 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:43 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb" returned: 0 in 0.412s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-144e8250-6d62-443c-ad0d-f05311cea4bb" released by "_copy_volume_from_snapshot" :: held 4.330s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-quobyte-8941ecea-8238-4c81-9f91-26ab5a98fbf1" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-8941ecea-8238-4c81-9f91-26ab5a98fbf1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Deleting offline snapshot 8941ecea-8238-4c81-9f91-26ab5a98fbf1 of volume 1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] snapshot_file for this snap is: volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ad3c40-f897-4b03-ae21-82271d081167]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:43 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 Apr 15 13:38:43 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:44 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1" returned: 0 in 0.498s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:38:44 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[554ba4b6-8278-422a-b95f-a57a64fe1d2b]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:44 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c Apr 15 13:38:44 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:44 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:44 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 Apr 15 13:38:44 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:45 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1" returned: 0 in 0.479s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:45 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1 Apr 15 13:38:45 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:45 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c.8941ecea-8238-4c81-9f91-26ab5a98fbf1" returned: 0 in 0.414s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-8941ecea-8238-4c81-9f91-26ab5a98fbf1" released by "_delete_snapshot" :: held 1.913s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.170s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.410s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a615ba73-18f1-4c99-8523-5059f807b13b]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25ccb48-6551-4fef-8348-94b888a84efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144e8250-6d62-443c-ad0d-f05311cea4bb', 'volume_size': 1, 'source_volid': '1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c', 'source_volstatus': 'available'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08936049-3aca-42a6-9d6b-4c6c59676d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:45 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Volume volume-144e8250-6d62-443c-ad0d-f05311cea4bb (144e8250-6d62-443c-ad0d-f05311cea4bb): created successfully Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08936049-3aca-42a6-9d6b-4c6c59676d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:45 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (e865a774-5027-4e9b-9c5f-2bb3c76485d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:45 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-1e5c9731-e3e3-4dbc-b27f-216ed69740fa tempest-VolumesGetTest-1401439631 None] Created volume successfully. Apr 15 13:38:45 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 Apr 15 13:38:45 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:46 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29" returned: 0 in 0.495s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16900ee-8bbb-49ad-8a21-d4a0760e24df]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:46 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 Apr 15 13:38:46 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (3403d2dd-cb7c-431e-a2e7-eb938431e2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef432e3-6571-4ead-a0eb-583326f8b998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef432e3-6571-4ead-a0eb-583326f8b998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1030350464',display_name='tempest-VolumesGetTest-Volume-1266989779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9936285-690e-4a63-9d2a-0c406be446ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:47Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:46 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014a03bb-bb4a-4c90-84b0-973110136c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014a03bb-bb4a-4c90-84b0-973110136c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e90e97-9410-4400-9f57-334bf6b481bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e90e97-9410-4400-9f57-334bf6b481bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9936285-690e-4a63-9d2a-0c406be446ad', 'volume_name': 'volume-a9936285-690e-4a63-9d2a-0c406be446ad', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f35971-7527-421b-b826-8736c1f099cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f35971-7527-421b-b826-8736c1f099cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf86bae-aa2f-4e90-b2ef-18113ece2e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:46 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Volume a9936285-690e-4a63-9d2a-0c406be446ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9936285-690e-4a63-9d2a-0c406be446ad', 'volume_size': 1} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29" returned: 0 in 0.573s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:46 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img Apr 15 13:38:46 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:48 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img" returned: 0 in 2.049s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:48 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45cf4e-5bb1-4f7b-a62c-7d53e1f60134]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:49 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 Apr 15 13:38:49 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:49 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29" returned: 0 in 0.622s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:49 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:38:49 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Converted 1024.00 MB image at 499.41 MB/s Apr 15 13:38:49 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] a9a92bff-3051-4bbf-ad99-343d60c3c4bd was raw, converting to qcow2 {{(pid=82595) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 15 13:38:49 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[39823ccf-a382-4014-8e4a-0d1d5f22e998]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:49 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img Apr 15 13:38:49 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:50 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img" returned: 0 in 0.474s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:50 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img Apr 15 13:38:50 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:50 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img" returned: 1 in 0.474s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:38:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img /opt/stack/data/cinder/conversion/vol_upload_hce_h13l {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:50 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img /opt/stack/data/cinder/conversion/vol_upload_hce_h13l Apr 15 13:38:50 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:50 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img /opt/stack/data/cinder/conversion/vol_upload_hce_h13l" returned: 0 in 0.427s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:50 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Image conversion details: src /opt/stack/data/cinder/conversion/52d33591-33f0-4ae2-a69f-18a162855c29.temp_image.a9a92bff-3051-4bbf-ad99-343d60c3c4bdjj1vuhqa.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hce_h13l {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:38:50 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 15 13:38:50 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f04d26-43c7-409a-9c59-bb597a8b628e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hce_h13l {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:51 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hce_h13l Apr 15 13:38:51 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:51 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hce_h13l" returned: 0 in 0.474s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.455s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Uploaded volume to glance image-id: a9a92bff-3051-4bbf-ad99-343d60c3c4bd. {{(pid=82595) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.673s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1633320319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd02c74-49af-4576-9f7d-e8ea2e7d76a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0279804594f2441d82d232131f3e6153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:38Z,use_quota=True,user_id='768208327e944ac9919277c25ab68797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Creating volume 4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:38:52 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:52 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 1073741824 Apr 15 13:38:52 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:52 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2ec7084b-efae-4f45-88a7-5be8f07deb23 tempest-VolumesActionsTest-2063723577 None] Copy volume to image completed successfully. Apr 15 13:38:52 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 1073741824" returned: 0 in 0.508s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:52 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 Apr 15 13:38:52 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:53 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" returned: 0 in 0.430s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.351s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1030350464',display_name='tempest-VolumesGetTest-Volume-1266989779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9936285-690e-4a63-9d2a-0c406be446ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:47Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Creating volume a9936285-690e-4a63-9d2a-0c406be446ad {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:38:53 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c8fa94-dba3-4cc8-bf3c-37ecf920d024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:53 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad 1073741824 Apr 15 13:38:53 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202f01e7-3e62-403b-a269-eb7c1cc9ec66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:53 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Volume volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 (4cd02c74-49af-4576-9f7d-e8ea2e7d76a4): created successfully Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202f01e7-3e62-403b-a269-eb7c1cc9ec66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Flow 'volume_create_manager' (22a6000b-3475-450d-994c-7e1e14ef5827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:53 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-bd9c7589-2020-42fe-8145-b225144cd7e2 tempest-SnapshotDependencyTests-1480490794 None] Created volume successfully. Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Acquiring lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:53 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad 1073741824" returned: 0 in 0.547s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Acquiring lock "cinder-quobyte-52d33591-33f0-4ae2-a69f-18a162855c29" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Lock "cinder-quobyte-52d33591-33f0-4ae2-a69f-18a162855c29" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da5dd7-d4d3-48d2-aea6-1847576b280f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:53 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad Apr 15 13:38:53 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:53 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 Apr 15 13:38:53 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:54 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad" returned: 0 in 0.449s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.324s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Creating offline snapshot a83f69e1-b9f8-42c9-a711-3e2731aec741 of volume 4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf86bae-aa2f-4e90-b2ef-18113ece2e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9936285-690e-4a63-9d2a-0c406be446ad', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cd6f80-0a3a-425d-91fb-dd87db127eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[443d1596-1de7-4b9f-b4a4-ff915a83e7e1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:54 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Volume volume-a9936285-690e-4a63-9d2a-0c406be446ad (a9936285-690e-4a63-9d2a-0c406be446ad): created successfully Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cd6f80-0a3a-425d-91fb-dd87db127eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (3403d2dd-cb7c-431e-a2e7-eb938431e2e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:54 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a52d736d-1aa0-47c3-b21c-cbcc75f442eb tempest-VolumesGetTest-1401439631 None] Created volume successfully. Apr 15 13:38:54 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29" returned: 0 in 0.527s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:54 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 Apr 15 13:38:54 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:54 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29 Apr 15 13:38:54 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:54 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-52d33591-33f0-4ae2-a69f-18a162855c29" returned: 0 in 0.412s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Lock "cinder-quobyte-52d33591-33f0-4ae2-a69f-18a162855c29" released by "delete_volume" :: held 0.968s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:54 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" returned: 0 in 0.487s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:54 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 1G Apr 15 13:38:54 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Created reservations ['211f083b-1e21-42e8-89ec-3449449f589b', '8f1f7ffa-3d4e-4530-921c-8c5e3b3b0628', '0a6c3f3f-cc02-4b54-bc53-74f5995c7239', '8789c488-74f9-4617-885c-e88893bbdaa9'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:54 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:54 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:55 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.422s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:55 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Deleted volume successfully. Apr 15 13:38:55 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 1G" returned: 0 in 0.528s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-994d8ead-a460-42bc-848c-28dddf431b0b tempest-VolumesActionsTest-2063723577 None] Lock "cinder-52d33591-33f0-4ae2-a69f-18a162855c29-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:55 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 Apr 15 13:38:55 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-a9936285-690e-4a63-9d2a-0c406be446ad-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Lock "cinder-a9936285-690e-4a63-9d2a-0c406be446ad-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-quobyte-a9936285-690e-4a63-9d2a-0c406be446ad" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-a9936285-690e-4a63-9d2a-0c406be446ad" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc0886-ca81-42b9-88d4-ebad32dd8c16]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:55 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad Apr 15 13:38:55 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:55 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741" returned: 0 in 0.464s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:55 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 is being set with open permissions: ugo+rw Apr 15 13:38:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:55 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 Apr 15 13:38:55 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:56 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad" returned: 0 in 0.501s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:56 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad Apr 15 13:38:56 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:56 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741" returned: 0 in 0.452s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:56 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.info Apr 15 13:38:56 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:56 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a9936285-690e-4a63-9d2a-0c406be446ad" returned: 0 in 0.473s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-a9936285-690e-4a63-9d2a-0c406be446ad" released by "delete_volume" :: held 0.999s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Created reservations ['476977b0-464d-4836-8939-3835ea960905', '2919bf47-2d64-433e-80d4-0735417e4144', '58785792-6a53-40e8-b9c0-6dc8fb6a10df', '5f9daf65-c7bd-4a78-b902-d4ecefaeb7e1'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:56 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:56 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:56 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.info" returned: 0 in 0.485s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:56 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.info is being set with open permissions: ugo+rw Apr 15 13:38:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:56 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.info Apr 15 13:38:56 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:57 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.488s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:57 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Deleted volume successfully. Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-83f6e417-7474-4638-bd66-fcbb9eefab44 tempest-VolumesGetTest-1401439631 None] Lock "cinder-a9936285-690e-4a63-9d2a-0c406be446ad-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:57 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.info" returned: 0 in 0.484s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:57 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-663ec78a-f4ce-411c-bf42-143d55b41422 tempest-SnapshotDependencyTests-1480490794 None] Create snapshot completed successfully Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-144e8250-6d62-443c-ad0d-f05311cea4bb-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Lock "cinder-144e8250-6d62-443c-ad0d-f05311cea4bb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-quobyte-144e8250-6d62-443c-ad0d-f05311cea4bb" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-144e8250-6d62-443c-ad0d-f05311cea4bb" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7a2d7b-9f67-4dad-b050-b0e2406e34ed]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:57 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb Apr 15 13:38:57 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:58 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb" returned: 0 in 0.599s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:58 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb Apr 15 13:38:58 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Flow 'volume_create_manager' (ff93ba6b-e861-435f-9acc-706ca5f8d2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46dc19b2-1fe6-4a71-a6e6-b817c1008e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46dc19b2-1fe6-4a71-a6e6-b817c1008e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5436a905-e27e-4a44-891b-20d2940f43b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0279804594f2441d82d232131f3e6153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a83f69e1-b9f8-42c9-a711-3e2731aec741,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:38:58Z,use_quota=True,user_id='768208327e944ac9919277c25ab68797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1671fab-b305-4dd0-bb13-b039ba7ff951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1671fab-b305-4dd0-bb13-b039ba7ff951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6f17ce-4911-4f9a-9f6f-9b5be061db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6f17ce-4911-4f9a-9f6f-9b5be061db09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5436a905-e27e-4a44-891b-20d2940f43b2', 'volume_name': 'volume-5436a905-e27e-4a44-891b-20d2940f43b2', 'volume_size': 1, 'snapshot_id': 'a83f69e1-b9f8-42c9-a711-3e2731aec741'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fafae6-cc7a-4ee9-871f-5a52c772a18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fafae6-cc7a-4ee9-871f-5a52c772a18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73b0137-09e3-42a1-b868-be8fc8df97e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:38:58 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Volume 5436a905-e27e-4a44-891b-20d2940f43b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5436a905-e27e-4a44-891b-20d2940f43b2', 'volume_size': 1, 'snapshot_id': 'a83f69e1-b9f8-42c9-a711-3e2731aec741'} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "cinder-quobyte-a83f69e1-b9f8-42c9-a711-3e2731aec741-5436a905-e27e-4a44-891b-20d2940f43b2" by "_create_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-a83f69e1-b9f8-42c9-a711-3e2731aec741-5436a905-e27e-4a44-891b-20d2940f43b2" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Creating volume 5436a905-e27e-4a44-891b-20d2940f43b2 from snapshot a83f69e1-b9f8-42c9-a711-3e2731aec741 {{(pid=82595) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "cinder-quobyte-5436a905-e27e-4a44-891b-20d2940f43b2" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-5436a905-e27e-4a44-891b-20d2940f43b2" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] snapshot: a83f69e1-b9f8-42c9-a711-3e2731aec741, volume: 5436a905-e27e-4a44-891b-20d2940f43b2, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[2798e00b-774f-49f4-b54c-736aeb0840ff]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:58 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 Apr 15 13:38:58 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:58 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-144e8250-6d62-443c-ad0d-f05311cea4bb" returned: 0 in 0.512s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-144e8250-6d62-443c-ad0d-f05311cea4bb" released by "delete_volume" :: held 1.141s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Created reservations ['cedcd186-6cf7-4970-a503-1ce47c36a64a', '8abd8409-f516-4d44-996a-ce9018d377be', '4583f7c7-0a06-4a46-b7cd-e9031aad3cf4', '9f76cc7d-165d-4581-800c-717877b3e194'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:38:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:59 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:38:59 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:59 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741" returned: 0 in 0.550s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb904b08-06bd-41fb-9a20-b76180b6ed04]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:59 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 Apr 15 13:38:59 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:59 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.528s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:38:59 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Deleted volume successfully. Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a89ffca5-73a2-4905-99eb-6167cdb1407a tempest-VolumesGetTest-1401439631 None] Lock "cinder-144e8250-6d62-443c-ad0d-f05311cea4bb-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:38:59 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" returned: 0 in 0.551s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:38:59 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 Apr 15 13:38:59 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Lock "cinder-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-quobyte-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:38:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae9fe43-38b2-46fa-8025-f5bf36a553ae]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:00 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c Apr 15 13:39:00 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Flow 'volume_create_manager' (e56a8434-03b9-414f-b0c4-7aaf0633f4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3c85c9-de3a-435e-9ce0-ba1297f4006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3c85c9-de3a-435e-9ce0-ba1297f4006d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-720979823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce8d405-0374-45fa-8d18-25bbec7b90ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c87af354a046c992011e94ba75c3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:00Z,use_quota=True,user_id='74373ec5f3b544a39ef4be46bec453d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e797a3-2f19-4369-a0a0-47120894b51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e797a3-2f19-4369-a0a0-47120894b51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681406a1-680b-4e4d-a6ef-c88c21720cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681406a1-680b-4e4d-a6ef-c88c21720cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce8d405-0374-45fa-8d18-25bbec7b90ea', 'volume_name': 'volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea', 'volume_size': 2}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0d15ff-383f-42d7-ba5f-01047555b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0d15ff-383f-42d7-ba5f-01047555b91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892b7f16-d364-49e2-8f2c-91101e277a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:00 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Volume 8ce8d405-0374-45fa-8d18-25bbec7b90ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea', 'volume_size': 2} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:00 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c" returned: 0 in 0.928s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:00 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c Apr 15 13:39:00 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:01 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c" returned: 0 in 0.957s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:01 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c" released by "delete_volume" :: held 1.931s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:01 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Created reservations ['759f9b7a-e2da-4c52-8042-36dc1d905e1d', '34e18915-ba86-4a8c-b32d-ba64578a6866', '9781288e-f4d8-4ce7-8ffd-5c76153b0a49', '8b7a2873-7a2b-4be2-9330-bde1c17c7b9d'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:02 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:02 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:02 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2" returned: 0 in 2.232s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9cc262-1160-4aa8-9f17-c02b59d3bbae]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:02 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 Apr 15 13:39:02 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:02 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.466s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:02 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Deleted volume successfully. Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4d560a2b-bc90-4218-a64a-afef62cc0814 tempest-VolumesGetTest-1401439631 None] Lock "cinder-1c1d1908-7ce7-4d3a-a8ef-c75cfe06441c-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (a0eedb9a-d050-4474-a507-619ff34764df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db761812-0dd5-4f06-8b45-c8bff2eff1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db761812-0dd5-4f06-8b45-c8bff2eff1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-725529841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9339429f-a335-400f-8e68-6577a3f956ca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:03Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41838db5-2d1f-414c-b1c0-26fc1ff37b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41838db5-2d1f-414c-b1c0-26fc1ff37b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe31d7f3-5b14-4c8e-abfc-2a391d8185e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.image.glance [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Creating Keystone auth plugin from conf {{(pid=82595) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 13:39:02 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" returned: 0 in 0.698s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:39:02 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Converted 1024.00 MB image at 458.37 MB/s Apr 15 13:39:02 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 is being set with open permissions: ugo+rw Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:02 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 Apr 15 13:39:02 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe31d7f3-5b14-4c8e-abfc-2a391d8185e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9339429f-a335-400f-8e68-6577a3f956ca', 'volume_name': 'volume-9339429f-a335-400f-8e68-6577a3f956ca', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d42633d-6a4a-4827-8d12-7bcfa029bd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d42633d-6a4a-4827-8d12-7bcfa029bd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1393e452-fb32-49a1-9b0a-119268f00178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:02 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Volume 9339429f-a335-400f-8e68-6577a3f956ca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9339429f-a335-400f-8e68-6577a3f956ca', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 13:39:02 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Trying to clone 9339429f-a335-400f-8e68-6577a3f956ca from image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]). {{(pid=82595) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 13:39:03 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Image download 20.69 MB at 20.69 MB/s Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[378c3cf8-1824-4cda-af14-07c6260556ee]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:03 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD Apr 15 13:39:03 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:03 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2" returned: 0 in 0.457s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-5436a905-e27e-4a44-891b-20d2940f43b2" released by "_copy_volume_from_snapshot" :: held 4.546s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-a83f69e1-b9f8-42c9-a711-3e2731aec741-5436a905-e27e-4a44-891b-20d2940f43b2" released by "_create_volume_from_snapshot" :: held 4.563s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.572s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.013s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-720979823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce8d405-0374-45fa-8d18-25bbec7b90ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c87af354a046c992011e94ba75c3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:00Z,use_quota=True,user_id='74373ec5f3b544a39ef4be46bec453d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Creating volume 8ce8d405-0374-45fa-8d18-25bbec7b90ea {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:03 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea 2147483648 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:03 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea 2147483648 Apr 15 13:39:03 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73b0137-09e3-42a1-b868-be8fc8df97e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5436a905-e27e-4a44-891b-20d2940f43b2', 'volume_size': 1, 'snapshot_id': 'a83f69e1-b9f8-42c9-a711-3e2731aec741'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a6dfe3-a94f-45b3-87cf-9059a6909316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:03 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Volume volume-5436a905-e27e-4a44-891b-20d2940f43b2 (5436a905-e27e-4a44-891b-20d2940f43b2): created successfully Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a6dfe3-a94f-45b3-87cf-9059a6909316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Flow 'volume_create_manager' (ff93ba6b-e861-435f-9acc-706ca5f8d2b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:03 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c5583edc-302c-4830-9653-b14208382a63 tempest-SnapshotDependencyTests-1480490794 None] Created volume successfully. Apr 15 13:39:03 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Temporary image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 is fetched for user 3ddcd1e053fd447baaa7966e3a89252e. {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[598d7100-f970-442a-a052-8ee04a887078]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:03 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD Apr 15 13:39:03 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:03 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea 2147483648" returned: 0 in 0.553s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "cinder-a83f69e1-b9f8-42c9-a711-3e2731aec741-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-a83f69e1-b9f8-42c9-a711-3e2731aec741-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "cinder-quobyte-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "cinder-quobyte-a83f69e1-b9f8-42c9-a711-3e2731aec741" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:03 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea Apr 15 13:39:03 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-a83f69e1-b9f8-42c9-a711-3e2731aec741" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Deleting offline snapshot a83f69e1-b9f8-42c9-a711-3e2731aec741 of volume 4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] snapshot_file for this snap is: volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[63428000-9cc6-438a-9bb9-1e18c5b2777d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:03 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 Apr 15 13:39:03 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:04 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:04 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea" returned: 0 in 0.432s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.148s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-725529841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9339429f-a335-400f-8e68-6577a3f956ca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:03Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Creating volume 9339429f-a335-400f-8e68-6577a3f956ca {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:04 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892b7f16-d364-49e2-8f2c-91101e277a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea', 'volume_size': 2}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe9e864-ff39-4891-9c59-b14b525c90a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:04 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca 1073741824 Apr 15 13:39:04 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:04 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Volume volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea (8ce8d405-0374-45fa-8d18-25bbec7b90ea): created successfully Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe9e864-ff39-4891-9c59-b14b525c90a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Flow 'volume_create_manager' (e56a8434-03b9-414f-b0c4-7aaf0633f4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:04 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-d692b1e9-280e-49ae-8509-7a785a06f6d4 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Created volume successfully. Apr 15 13:39:04 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741" returned: 0 in 0.514s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc8afee-cd7b-4987-927a-2ddd0b7ad6d1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:04 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 Apr 15 13:39:04 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:04 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca 1073741824" returned: 0 in 0.508s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:04 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca Apr 15 13:39:04 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:04 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" returned: 0 in 0.519s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:04 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 Apr 15 13:39:04 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:05 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca" returned: 0 in 0.415s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.660s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Creating offline snapshot ebfd731b-568c-4f2c-a477-a693579ea8ac of volume 8ce8d405-0374-45fa-8d18-25bbec7b90ea {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Attempting download of 082fb149-5a21-4aac-9c2e-bdc7043feaf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}])) to volume 9339429f-a335-400f-8e68-6577a3f956ca. {{(pid=82595) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d32cf8-2e14-45ba-9c03-29e941454ed3]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d76ab7d-a363-4017-a26d-686cf213ec04]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_w9gvfsn7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:05 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea Apr 15 13:39:05 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:05 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_w9gvfsn7 Apr 15 13:39:05 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:05 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:05 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741 Apr 15 13:39:05 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:05 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea" returned: 0 in 0.493s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac 2G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:05 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac 2G Apr 15 13:39:05 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:05 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_w9gvfsn7" returned: 0 in 0.485s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_w9gvfsn7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:05 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4.a83f69e1-b9f8-42c9-a711-3e2731aec741" returned: 0 in 0.415s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-a83f69e1-b9f8-42c9-a711-3e2731aec741" released by "_delete_snapshot" :: held 1.980s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" released by "delete_snapshot" :: held 1.990s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:05 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_w9gvfsn7 Apr 15 13:39:05 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Created reservations ['654e5f7a-b94b-4e80-8333-b103c5111bb0', '4e4411a1-6ff9-440f-b6b7-405d26946ae9', '8e8b89a0-b0dd-4808-9a84-dd6c0052386f', 'ec0207f9-2bbb-4e8f-9da0-4f25dc46cc53'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:05 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Delete snapshot completed successfully. Apr 15 13:39:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-01978353-bb61-444f-98c4-adfd1bc77de4 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-a83f69e1-b9f8-42c9-a711-3e2731aec741-delete_snapshot" released by "delete_snapshot" :: held 2.081s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:06 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac 2G" returned: 0 in 0.489s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:06 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_w9gvfsn7" returned: 1 in 0.484s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_082fb149-5a21-4aac-9c2e-bdc7043feaf2_w9gvfsn7' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[80891570-c23c-43dd-ae47-6f6a2bb0afeb]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:06 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:06 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:06 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD Apr 15 13:39:06 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:06 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac" returned: 0 in 0.442s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:06 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac is being set with open permissions: ugo+rw Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:06 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac Apr 15 13:39:06 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:06 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] 082fb149-5a21-4aac-9c2e-bdc7043feaf2 was qcow2, converting to raw {{(pid=82595) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:06 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca Apr 15 13:39:06 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "cinder-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "cinder-quobyte-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[35794e31-ea9d-4711-9cf5-6897ba415762]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:07 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac" returned: 0 in 0.430s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:07 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 Apr 15 13:39:07 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:07 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.info Apr 15 13:39:07 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:07 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" returned: 0 in 0.538s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:07 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4 Apr 15 13:39:07 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:07 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca" returned: 0 in 0.893s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_082fb149-5a21-4aac-9c2e-bdc7043feaf2_7akedgptdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:39:07 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Converted 112.00 MB image at 112.00 MB/s Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:07 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca 1G Apr 15 13:39:07 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:07 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.info" returned: 0 in 0.568s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:07 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.info is being set with open permissions: ugo+rw Apr 15 13:39:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:07 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.info Apr 15 13:39:07 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:08 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" returned: 0 in 0.437s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4" released by "delete_volume" :: held 1.010s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:08 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca 1G" returned: 0 in 0.424s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Created reservations ['a79ea856-129b-4c0d-bf4c-71a89ed61b8e', '9236db4f-4218-4901-b8c4-8e8375e4c08d', 'bfe334ff-b6ae-4f7f-a65f-e987a26eee46', 'd03fa577-dde6-4900-8db2-e5b6fcc906a7'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d40f695-ae43-45cc-8d72-07ed1da9973f]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:08 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:08 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:08 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca Apr 15 13:39:08 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:08 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.info" returned: 0 in 0.458s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.944s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:08 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-43e0fe40-a2ae-41ef-a5ef-fbd869660c83 tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Create snapshot completed successfully Apr 15 13:39:08 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:08 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca" returned: 0 in 0.462s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.438s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:08 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Deleted volume successfully. Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-5dd93990-15ad-44d8-ba6d-c7953072ae8f tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-4cd02c74-49af-4576-9f7d-e8ea2e7d76a4-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:08 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca Apr 15 13:39:08 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Acquiring lock "cinder-ebfd731b-568c-4f2c-a477-a693579ea8ac-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "cinder-ebfd731b-568c-4f2c-a477-a693579ea8ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Acquiring lock "cinder-quobyte-8ce8d405-0374-45fa-8d18-25bbec7b90ea" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "cinder-quobyte-8ce8d405-0374-45fa-8d18-25bbec7b90ea" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Acquiring lock "cinder-quobyte-ebfd731b-568c-4f2c-a477-a693579ea8ac" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "cinder-quobyte-ebfd731b-568c-4f2c-a477-a693579ea8ac" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Deleting offline snapshot ebfd731b-568c-4f2c-a477-a693579ea8ac of volume 8ce8d405-0374-45fa-8d18-25bbec7b90ea {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] snapshot_file for this snap is: volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b35c20e-7307-409d-ac98-05635e6fc1a7]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:08 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac Apr 15 13:39:08 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:09 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca" returned: 1 in 0.492s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Downloaded image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}])) to volume 9339429f-a335-400f-8e68-6577a3f956ca successfully. {{(pid=82595) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Temporary image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 for user 3ddcd1e053fd447baaa7966e3a89252e is deleted. {{(pid=82595) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.volume.volume_utils [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Marking volume 9339429f-a335-400f-8e68-6577a3f956ca as bootable. {{(pid=82595) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Copying metadata from image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 to 9339429f-a335-400f-8e68-6577a3f956ca. {{(pid=82595) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Creating volume glance metadata for volume 9339429f-a335-400f-8e68-6577a3f956ca backed by image 082fb149-5a21-4aac-9c2e-bdc7043feaf2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82595) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1393e452-fb32-49a1-9b0a-119268f00178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9339429f-a335-400f-8e68-6577a3f956ca', 'volume_size': 1, 'image_id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f1f4819e46940959dd25da1c8a10528', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '082fb149-5a21-4aac-9c2e-bdc7043feaf2', 'created_at': datetime.datetime(2026, 4, 15, 11, 27, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 11, 27, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/082fb149-5a21-4aac-9c2e-bdc7043feaf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297ef537-290b-4ed0-ad3b-c94c8b5fc866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:09 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Volume volume-9339429f-a335-400f-8e68-6577a3f956ca (9339429f-a335-400f-8e68-6577a3f956ca): created successfully Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297ef537-290b-4ed0-ad3b-c94c8b5fc866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (a0eedb9a-d050-4474-a507-619ff34764df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:09 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e5f2917c-8221-48ef-aa8b-bcac5671c97b tempest-VolumesGetTest-1401439631 None] Created volume successfully. Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "cinder-5436a905-e27e-4a44-891b-20d2940f43b2-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-5436a905-e27e-4a44-891b-20d2940f43b2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "cinder-quobyte-5436a905-e27e-4a44-891b-20d2940f43b2" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-5436a905-e27e-4a44-891b-20d2940f43b2" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5293847-d36e-4041-a504-b1e3642c2bc4]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:09 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac" returned: 0 in 0.504s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6c3138-d73f-451c-afa7-12f7bdefb8dd]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:09 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 Apr 15 13:39:09 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:09 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea Apr 15 13:39:09 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:09 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2" returned: 0 in 0.475s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:09 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2 Apr 15 13:39:09 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:09 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea" returned: 0 in 0.480s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:09 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac Apr 15 13:39:09 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:10 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-5436a905-e27e-4a44-891b-20d2940f43b2" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-quobyte-5436a905-e27e-4a44-891b-20d2940f43b2" released by "delete_volume" :: held 0.978s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Created reservations ['c885f6ce-e46a-45e6-ab1a-c911712b5813', '64d4d765-8261-4f85-8d49-2e7bd9d8dc69', '9fd49241-9a87-4656-bb39-0f61e3bbcb7a', 'dcffc956-b6a7-443d-95d6-1561e1112e68'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:10 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac" returned: 0 in 0.537s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:10 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac Apr 15 13:39:10 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (a624514f-f6b6-49f1-a19c-0c00602e9d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac82bbc-77d5-4638-a269-2d357ccfdd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac82bbc-77d5-4638-a269-2d357ccfdd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1868033682',display_name='tempest-VolumesGetTest-Volume-1652697335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258a8cb6-9903-4d92-8010-5e2ac24f3e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:10Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ae014c-4a3f-4e03-947b-59a8a1555b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ae014c-4a3f-4e03-947b-59a8a1555b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b35bb7-f37d-4756-b78f-6db3eb727d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b35bb7-f37d-4756-b78f-6db3eb727d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '258a8cb6-9903-4d92-8010-5e2ac24f3e6b', 'volume_name': 'volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6015ee7e-3e6b-4ba4-9022-0f8ac1a7d673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6015ee7e-3e6b-4ba4-9022-0f8ac1a7d673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87ef5ff-f415-4040-bdae-057fffc6161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:10 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Volume 258a8cb6-9903-4d92-8010-5e2ac24f3e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b', 'volume_size': 1} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1868033682',display_name='tempest-VolumesGetTest-Volume-1652697335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258a8cb6-9903-4d92-8010-5e2ac24f3e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916faab8dfe7446f90e14f5f8618b973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:10Z,use_quota=True,user_id='3ddcd1e053fd447baaa7966e3a89252e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Creating volume 258a8cb6-9903-4d92-8010-5e2ac24f3e6b {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:10 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:10 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b 1073741824 Apr 15 13:39:10 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:10 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:10 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:10 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea.ebfd731b-568c-4f2c-a477-a693579ea8ac" returned: 0 in 0.403s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "cinder-quobyte-ebfd731b-568c-4f2c-a477-a693579ea8ac" released by "_delete_snapshot" :: held 1.977s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "cinder-quobyte-8ce8d405-0374-45fa-8d18-25bbec7b90ea" released by "delete_snapshot" :: held 1.988s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Created reservations ['6f952208-0ea8-4c4e-b19b-4a492335a1ea', 'b114bef3-d6fe-4757-9767-4165975fa14e', '6a843eea-552f-475b-918e-d977e3caf3cd', '9a22bd6c-f313-4872-9304-7b1c3f55f850'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:10 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Delete snapshot completed successfully. Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dd6c68e6-beb3-45b7-aac3-73ba88b0501b tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "cinder-ebfd731b-568c-4f2c-a477-a693579ea8ac-delete_snapshot" released by "delete_snapshot" :: held 2.095s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:10 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.460s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:10 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Deleted volume successfully. Apr 15 13:39:10 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b 1073741824" returned: 0 in 0.511s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2eef2803-d233-49e6-8749-f703a39348a8 tempest-SnapshotDependencyTests-1480490794 None] Lock "cinder-5436a905-e27e-4a44-891b-20d2940f43b2-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:10 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b Apr 15 13:39:10 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:11 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b" returned: 0 in 0.435s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87ef5ff-f415-4040-bdae-057fffc6161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957c7e3a-88b7-458c-b339-7676a99ec267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:11 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Volume volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b (258a8cb6-9903-4d92-8010-5e2ac24f3e6b): created successfully Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957c7e3a-88b7-458c-b339-7676a99ec267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Flow 'volume_create_manager' (a624514f-f6b6-49f1-a19c-0c00602e9d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:11 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-63858f45-97e6-42c6-bb69-668236284fec tempest-VolumesGetTest-1401439631 None] Created volume successfully. Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Acquiring lock "cinder-8ce8d405-0374-45fa-8d18-25bbec7b90ea-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "cinder-8ce8d405-0374-45fa-8d18-25bbec7b90ea-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Acquiring lock "cinder-quobyte-8ce8d405-0374-45fa-8d18-25bbec7b90ea" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "cinder-quobyte-8ce8d405-0374-45fa-8d18-25bbec7b90ea" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:12 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[12724a58-2e37-4047-a7bf-77dec5336cd8]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:12 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea Apr 15 13:39:12 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:12 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-258a8cb6-9903-4d92-8010-5e2ac24f3e6b-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea" returned: 0 in 0.533s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Lock "cinder-258a8cb6-9903-4d92-8010-5e2ac24f3e6b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:12 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea Apr 15 13:39:12 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-quobyte-258a8cb6-9903-4d92-8010-5e2ac24f3e6b" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-258a8cb6-9903-4d92-8010-5e2ac24f3e6b" acquired by "delete_volume" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:12 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[f375f776-8d04-4ac3-9786-2c9c56da9878]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:12 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b Apr 15 13:39:12 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:12 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8ce8d405-0374-45fa-8d18-25bbec7b90ea" returned: 0 in 0.449s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "cinder-quobyte-8ce8d405-0374-45fa-8d18-25bbec7b90ea" released by "delete_volume" :: held 1.034s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Created reservations ['a524e067-a323-4e47-8060-bdf0b46657b1', 'df2591b6-416c-4a1b-8d95-f4a23d9f7bd6', '54a17271-646c-4632-94a0-6a42df2ddbac', '4bf49e17-e1bc-4c5b-96c7-bbdaf37f5442'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:13 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:13 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:13 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b" returned: 0 in 0.518s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:13 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b Apr 15 13:39:13 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:13 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.419s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:13 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Deleted volume successfully. Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-264fc69a-dced-4e90-a9dd-d3561a9a1cdf tempest-VolumesSnapshotNegativeTestJSON-1642119124 None] Lock "cinder-8ce8d405-0374-45fa-8d18-25bbec7b90ea-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:13 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-258a8cb6-9903-4d92-8010-5e2ac24f3e6b" returned: 0 in 0.518s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-258a8cb6-9903-4d92-8010-5e2ac24f3e6b" released by "delete_volume" :: held 1.056s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Created reservations ['89f52ac2-dfc8-43c6-a1f9-6866ed5961ad', '21328e46-6360-416c-b009-369578640262', '76dd289d-cb68-4a18-896e-99ef696d1fa8', '248ea476-ac19-41c6-843a-7806f65c0921'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:13 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:13 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:14 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.466s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:14 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:14 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Deleted volume successfully. Apr 15 13:39:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9ac14d52-1822-4bc4-b756-e25b2a0f3084 tempest-VolumesGetTest-1401439631 None] Lock "cinder-258a8cb6-9903-4d92-8010-5e2ac24f3e6b-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-9339429f-a335-400f-8e68-6577a3f956ca-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Lock "cinder-9339429f-a335-400f-8e68-6577a3f956ca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Acquiring lock "cinder-quobyte-9339429f-a335-400f-8e68-6577a3f956ca" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-9339429f-a335-400f-8e68-6577a3f956ca" acquired by "delete_volume" :: waited 0.021s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:14 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ff0c42-d263-4b38-b91a-f3beb27b2bfd]: (4, 'raw') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:14 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca Apr 15 13:39:14 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:15 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca" returned: 0 in 0.596s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:15 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca Apr 15 13:39:15 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (730eac98-b7d4-41d9-9fa3-f7986f3fae62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee56a565-c62a-4a96-a917-490a6abc4a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee56a565-c62a-4a96-a917-490a6abc4a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601622291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf254b61-7219-4521-90d0-07ea740f7c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:16Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c460cf4-a188-4f09-bd28-5afedfa27c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c460cf4-a188-4f09-bd28-5afedfa27c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57127b9d-1f1d-4049-bb4a-e234a29c62a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57127b9d-1f1d-4049-bb4a-e234a29c62a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf254b61-7219-4521-90d0-07ea740f7c1b', 'volume_name': 'volume-cf254b61-7219-4521-90d0-07ea740f7c1b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebe72ea-3ab7-4bd4-ac16-f85e65bd1bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebe72ea-3ab7-4bd4-ac16-f85e65bd1bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2848cf0-3b78-4622-8cda-97d46db341c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:15 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume cf254b61-7219-4521-90d0-07ea740f7c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf254b61-7219-4521-90d0-07ea740f7c1b', 'volume_size': 1} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601622291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf254b61-7219-4521-90d0-07ea740f7c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:16Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Creating volume cf254b61-7219-4521-90d0-07ea740f7c1b {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:15 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:15 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b 1073741824 Apr 15 13:39:15 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:16 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca" returned: 1 in 0.548s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca' failed. Not Retrying. {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:16 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca Apr 15 13:39:16 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:16 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b 1073741824" returned: 0 in 0.560s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:16 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b Apr 15 13:39:16 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:16 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9339429f-a335-400f-8e68-6577a3f956ca" returned: 0 in 0.543s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Lock "cinder-quobyte-9339429f-a335-400f-8e68-6577a3f956ca" released by "delete_volume" :: held 1.738s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Created reservations ['c9e73458-fc38-46e4-a7f9-e25331858ec5', '6eabf267-9b71-4b13-9dee-241c1c07bb18', '3b7f6036-365e-4c6a-b528-5ae72a3834e9', 'd957754b-78af-4830-b9db-9d9c1a50d8b8'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:16 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:16 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:16 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b" returned: 0 in 0.474s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2848cf0-3b78-4622-8cda-97d46db341c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf254b61-7219-4521-90d0-07ea740f7c1b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:16 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc69882-4b82-4069-938f-5856624f9b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:17 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume volume-cf254b61-7219-4521-90d0-07ea740f7c1b (cf254b61-7219-4521-90d0-07ea740f7c1b): created successfully Apr 15 13:39:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc69882-4b82-4069-938f-5856624f9b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (730eac98-b7d4-41d9-9fa3-f7986f3fae62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:17 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-4fca9bf1-0325-47c4-b522-585f942e7433 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created volume successfully. Apr 15 13:39:17 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.502s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:17 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:17 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Deleted volume successfully. Apr 15 13:39:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-af662210-bf2b-4f7e-bca2-f629bd5e6276 tempest-VolumesGetTest-1401439631 None] Lock "cinder-9339429f-a335-400f-8e68-6577a3f956ca-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Creating offline snapshot 3d9bb012-ddaf-410e-b865-b01dc8098f90 of volume cf254b61-7219-4521-90d0-07ea740f7c1b {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:39:18 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6488740-f99a-45c4-b23a-b3de71f8b212]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:18 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b Apr 15 13:39:18 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:18 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b" returned: 0 in 0.618s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:18 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 1G Apr 15 13:39:18 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Flow 'volume_create_manager' (49f5557d-e38d-47b3-85d5-0a338ba8cce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7475cad3-d9e6-4d14-8786-cf48a20992f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7475cad3-d9e6-4d14-8786-cf48a20992f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-285428809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937c626c-5be0-4540-8540-febf16a48f3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5db6e3b26791454298fd0b3c4bc50cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:19Z,use_quota=True,user_id='206ab20ce3dd4495a5deb24f1661e69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f78900-d3b3-4c1d-9ef9-bdff34565cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f78900-d3b3-4c1d-9ef9-bdff34565cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf995cc-7fce-438a-8844-56f9e4f45b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf995cc-7fce-438a-8844-56f9e4f45b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937c626c-5be0-4540-8540-febf16a48f3b', 'volume_name': 'volume-937c626c-5be0-4540-8540-febf16a48f3b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe93536-2e5d-49d3-9624-83a70f28cb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe93536-2e5d-49d3-9624-83a70f28cb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfb7906-4780-4ca6-aac4-75ea8404f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:19 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Volume 937c626c-5be0-4540-8540-febf16a48f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937c626c-5be0-4540-8540-febf16a48f3b', 'volume_size': 1} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:19 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 1G" returned: 0 in 0.495s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf254b61-7219-4521-90d0-07ea740f7c1b -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:19 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf254b61-7219-4521-90d0-07ea740f7c1b -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 Apr 15 13:39:19 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:19 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf254b61-7219-4521-90d0-07ea740f7c1b -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90" returned: 0 in 0.411s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:19 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 is being set with open permissions: ugo+rw Apr 15 13:39:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:19 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 Apr 15 13:39:19 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:20 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90" returned: 0 in 0.399s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:20 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.info Apr 15 13:39:20 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:20 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.info" returned: 0 in 0.415s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:20 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.info is being set with open permissions: ugo+rw Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:20 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.info Apr 15 13:39:20 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:20 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.info" returned: 0 in 0.393s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.799s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.785s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-285428809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937c626c-5be0-4540-8540-febf16a48f3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5db6e3b26791454298fd0b3c4bc50cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:19Z,use_quota=True,user_id='206ab20ce3dd4495a5deb24f1661e69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Creating volume 937c626c-5be0-4540-8540-febf16a48f3b {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:20 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:20 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b 1073741824 Apr 15 13:39:20 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:20 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0328b4ca-7122-441f-9b80-e58886f903cd tempest-CreateVolumesFromSnapshotTest-1143831402 None] Create snapshot completed successfully Apr 15 13:39:21 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b 1073741824" returned: 0 in 0.496s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:21 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b Apr 15 13:39:21 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (a0060ddc-adfa-45e7-b0a2-4614e6f25b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29d9b2f-6e1d-47ab-a07b-f2e5b725fe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29d9b2f-6e1d-47ab-a07b-f2e5b725fe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253002217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202fafc0-e449-4dc1-94f5-e11199349fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:21Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4b1239-3986-4e9d-a65c-f4f5c071eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4b1239-3986-4e9d-a65c-f4f5c071eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4787727-0a40-40b3-b263-f70079e61866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4787727-0a40-40b3-b263-f70079e61866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202fafc0-e449-4dc1-94f5-e11199349fb4', 'volume_name': 'volume-202fafc0-e449-4dc1-94f5-e11199349fb4', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb6a019-1cab-4fda-b2d3-b40f30d14308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb6a019-1cab-4fda-b2d3-b40f30d14308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d727c325-ec13-45bd-ac41-97c76cf7659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume 202fafc0-e449-4dc1-94f5-e11199349fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202fafc0-e449-4dc1-94f5-e11199349fb4', 'volume_size': 1} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (f8bcf105-e7f0-4ea0-abd0-6036521b2da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e96ae68-bcb9-4321-aef0-8cbfdeff3322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e96ae68-bcb9-4321-aef0-8cbfdeff3322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1899337352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4368f69d-fbdd-4ceb-872e-86fe11e50bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:22Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9545a9-a747-4d49-bb10-e8689fb9172f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9545a9-a747-4d49-bb10-e8689fb9172f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2963ed51-2ada-407b-a1ba-d9a147c294c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2963ed51-2ada-407b-a1ba-d9a147c294c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4368f69d-fbdd-4ceb-872e-86fe11e50bf9', 'volume_name': 'volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c61d24-7e82-4ae5-a4d9-6b902bb89af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c61d24-7e82-4ae5-a4d9-6b902bb89af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a509ad8f-f47f-4350-9b0e-5392d765e0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume 4368f69d-fbdd-4ceb-872e-86fe11e50bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9', 'volume_size': 1} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (6b03fe4b-a9fe-42b7-a09a-9a6b5dd7ef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79271c54-1599-4614-bf34-5eb38cea75c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79271c54-1599-4614-bf34-5eb38cea75c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-170206623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884fef15-e516-4885-9505-f65cc02171f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:22Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6daa878c-3629-4304-b9b9-8948925b75da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6daa878c-3629-4304-b9b9-8948925b75da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e70832c-16d1-42c0-9a89-d4f0a3bfac32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e70832c-16d1-42c0-9a89-d4f0a3bfac32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '884fef15-e516-4885-9505-f65cc02171f8', 'volume_name': 'volume-884fef15-e516-4885-9505-f65cc02171f8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e418ffe8-0846-45b5-ae02-eba930de8800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e418ffe8-0846-45b5-ae02-eba930de8800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a6b844-c373-405e-a831-dd2b0feea227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume 884fef15-e516-4885-9505-f65cc02171f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-884fef15-e516-4885-9505-f65cc02171f8', 'volume_size': 1} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:21 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b" returned: 0 in 0.502s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253002217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202fafc0-e449-4dc1-94f5-e11199349fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:21Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Creating volume 202fafc0-e449-4dc1-94f5-e11199349fb4 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:21 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfb7906-4780-4ca6-aac4-75ea8404f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937c626c-5be0-4540-8540-febf16a48f3b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19721c7-7879-4739-a0c0-1551c4b4eb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:21 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4 1073741824 Apr 15 13:39:21 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Volume volume-937c626c-5be0-4540-8540-febf16a48f3b (937c626c-5be0-4540-8540-febf16a48f3b): created successfully Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19721c7-7879-4739-a0c0-1551c4b4eb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Flow 'volume_create_manager' (49f5557d-e38d-47b3-85d5-0a338ba8cce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-792827a0-4925-43dd-bc4a-5113d34255c9 tempest-VolumesListTestJSON-440136330 None] Created volume successfully. Apr 15 13:39:21 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (77262bed-637f-4ed3-a8ad-291f7ee04137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170c7062-934f-42df-99fb-5cf5b95528f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170c7062-934f-42df-99fb-5cf5b95528f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809226173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82063ec-91ea-42d7-a6a9-227df36705c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:22Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f50906-aa30-4401-bdb8-bd1f8adf6f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f50906-aa30-4401-bdb8-bd1f8adf6f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00702ecd-a06a-448a-adb6-a5e91e14a3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00702ecd-a06a-448a-adb6-a5e91e14a3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82063ec-91ea-42d7-a6a9-227df36705c7', 'volume_name': 'volume-c82063ec-91ea-42d7-a6a9-227df36705c7', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c5c049-da22-4740-bac1-c43873c4f4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c5c049-da22-4740-bac1-c43873c4f4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b42593-17a0-4acf-a1c6-5a94de158ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume c82063ec-91ea-42d7-a6a9-227df36705c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82063ec-91ea-42d7-a6a9-227df36705c7', 'volume_size': 1} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (efebbf66-0221-4a0d-b33f-f6751da03e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d57ab86-9cb1-41b3-ae0b-cb9c35fcbbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d57ab86-9cb1-41b3-ae0b-cb9c35fcbbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-141503556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea596d6-4de6-4184-9423-aad835e76ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:22Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a51e57d-97a1-4215-aecc-517ccb74c6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a51e57d-97a1-4215-aecc-517ccb74c6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2ea351-beab-4c44-92e1-5bcfcb2da91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2ea351-beab-4c44-92e1-5bcfcb2da91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea596d6-4de6-4184-9423-aad835e76ad1', 'volume_name': 'volume-eea596d6-4de6-4184-9423-aad835e76ad1', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa79113-a7c7-4d2d-8d4f-397f1070e6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa79113-a7c7-4d2d-8d4f-397f1070e6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7774f4-186a-4a3d-8331-31e56554638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume eea596d6-4de6-4184-9423-aad835e76ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea596d6-4de6-4184-9423-aad835e76ad1', 'volume_size': 1} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Flow 'volume_create_manager' (91baa05c-a9f0-41c9-bf26-f0222dd77650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84de91d-1095-4589-b8fb-096883a88945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84de91d-1095-4589-b8fb-096883a88945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-280905507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f530fe-c039-40e2-a322-ac66245ba16d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5db6e3b26791454298fd0b3c4bc50cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:22Z,use_quota=True,user_id='206ab20ce3dd4495a5deb24f1661e69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81070f55-00b2-4792-a3ec-311b41f71208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81070f55-00b2-4792-a3ec-311b41f71208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c19142-9679-428e-9d69-ed85422ce357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c19142-9679-428e-9d69-ed85422ce357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f530fe-c039-40e2-a322-ac66245ba16d', 'volume_name': 'volume-53f530fe-c039-40e2-a322-ac66245ba16d', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d74428-8c6e-461b-9019-e3887f03c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d74428-8c6e-461b-9019-e3887f03c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8408be-a121-4f24-ac32-12bdc1609b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Volume 53f530fe-c039-40e2-a322-ac66245ba16d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f530fe-c039-40e2-a322-ac66245ba16d', 'volume_size': 1} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4 1073741824" returned: 0 in 0.605s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:22 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4 Apr 15 13:39:22 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:22 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4" returned: 0 in 0.396s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.259s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1899337352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4368f69d-fbdd-4ceb-872e-86fe11e50bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:22Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Creating volume 4368f69d-fbdd-4ceb-872e-86fe11e50bf9 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:22 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d727c325-ec13-45bd-ac41-97c76cf7659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202fafc0-e449-4dc1-94f5-e11199349fb4', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d783da-ec12-4bac-8705-49d4c333711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:22 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9 1073741824 Apr 15 13:39:22 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume volume-202fafc0-e449-4dc1-94f5-e11199349fb4 (202fafc0-e449-4dc1-94f5-e11199349fb4): created successfully Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d783da-ec12-4bac-8705-49d4c333711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (a0060ddc-adfa-45e7-b0a2-4614e6f25b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:22 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-943ed89c-d6c0-45cd-be80-6e1eda34f21c tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created volume successfully. Apr 15 13:39:23 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9 1073741824" returned: 0 in 0.493s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:23 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9 Apr 15 13:39:23 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:23 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9" returned: 0 in 0.406s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-170206623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884fef15-e516-4885-9505-f65cc02171f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:22Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Creating volume 884fef15-e516-4885-9505-f65cc02171f8 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:23 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a509ad8f-f47f-4350-9b0e-5392d765e0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:23 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8 1073741824 Apr 15 13:39:23 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9944bf4-5381-4d9e-b2e0-a92c4932a512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:23 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9 (4368f69d-fbdd-4ceb-872e-86fe11e50bf9): created successfully Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9944bf4-5381-4d9e-b2e0-a92c4932a512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (f8bcf105-e7f0-4ea0-abd0-6036521b2da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:23 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-583b524e-643c-42ba-96e0-a38d04925323 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created volume successfully. Apr 15 13:39:24 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8 1073741824" returned: 0 in 0.483s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:24 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8 Apr 15 13:39:24 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:24 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8" returned: 0 in 0.406s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.732s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809226173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82063ec-91ea-42d7-a6a9-227df36705c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:22Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Creating volume c82063ec-91ea-42d7-a6a9-227df36705c7 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:24 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:24 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7 1073741824 Apr 15 13:39:24 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a6b844-c373-405e-a831-dd2b0feea227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-884fef15-e516-4885-9505-f65cc02171f8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068839a7-99ca-4660-8f5f-bf52541b016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:24 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume volume-884fef15-e516-4885-9505-f65cc02171f8 (884fef15-e516-4885-9505-f65cc02171f8): created successfully Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068839a7-99ca-4660-8f5f-bf52541b016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (6b03fe4b-a9fe-42b7-a09a-9a6b5dd7ef2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:24 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c4352db8-3309-4ea2-a2ca-42e2b064f1cc tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created volume successfully. Apr 15 13:39:25 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7 1073741824" returned: 0 in 0.473s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:25 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7 Apr 15 13:39:25 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:25 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7" returned: 0 in 0.403s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.446s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-141503556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea596d6-4de6-4184-9423-aad835e76ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7a9b6bf384b019f09d3dfa041cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:22Z,use_quota=True,user_id='88112fde2eff45aaa94eafdfd68a5abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Creating volume eea596d6-4de6-4184-9423-aad835e76ad1 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:25 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b42593-17a0-4acf-a1c6-5a94de158ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82063ec-91ea-42d7-a6a9-227df36705c7', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:25 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1 1073741824 Apr 15 13:39:25 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d544b0c3-c239-4c32-9814-5af93553ce2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:25 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume volume-c82063ec-91ea-42d7-a6a9-227df36705c7 (c82063ec-91ea-42d7-a6a9-227df36705c7): created successfully Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d544b0c3-c239-4c32-9814-5af93553ce2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:25 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (77262bed-637f-4ed3-a8ad-291f7ee04137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:25 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-8eecd491-884a-4f08-8dd8-2d6f2b456a81 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created volume successfully. Apr 15 13:39:26 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1 1073741824" returned: 0 in 0.465s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:26 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1 Apr 15 13:39:26 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:26 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1" returned: 0 in 0.414s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.088s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-280905507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f530fe-c039-40e2-a322-ac66245ba16d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5db6e3b26791454298fd0b3c4bc50cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:22Z,use_quota=True,user_id='206ab20ce3dd4495a5deb24f1661e69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Creating volume 53f530fe-c039-40e2-a322-ac66245ba16d {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:26 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7774f4-186a-4a3d-8331-31e56554638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea596d6-4de6-4184-9423-aad835e76ad1', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:26 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d 1073741824 Apr 15 13:39:26 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7be76a-12b2-4587-9ab6-d5411dc0f1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:26 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Volume volume-eea596d6-4de6-4184-9423-aad835e76ad1 (eea596d6-4de6-4184-9423-aad835e76ad1): created successfully Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7be76a-12b2-4587-9ab6-d5411dc0f1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:26 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Flow 'volume_create_manager' (efebbf66-0221-4a0d-b33f-f6751da03e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:26 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-bd04454e-4634-4606-8fbf-7743cdbb1ff3 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created volume successfully. Apr 15 13:39:27 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d 1073741824" returned: 0 in 0.493s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:27 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d Apr 15 13:39:27 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:27 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d" returned: 0 in 0.415s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8408be-a121-4f24-ac32-12bdc1609b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f530fe-c039-40e2-a322-ac66245ba16d', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3cbe5f-a153-404b-9428-4afb66407c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:27 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Volume volume-53f530fe-c039-40e2-a322-ac66245ba16d (53f530fe-c039-40e2-a322-ac66245ba16d): created successfully Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3cbe5f-a153-404b-9428-4afb66407c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Flow 'volume_create_manager' (91baa05c-a9f0-41c9-bf26-f0222dd77650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:27 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-40b159c6-13f2-4ad3-858b-3e4bb903231b tempest-VolumesListTestJSON-440136330 None] Created volume successfully. Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-eea596d6-4de6-4184-9423-aad835e76ad1-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-eea596d6-4de6-4184-9423-aad835e76ad1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-quobyte-eea596d6-4de6-4184-9423-aad835e76ad1" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-eea596d6-4de6-4184-9423-aad835e76ad1" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf3db4-4399-4c75-a399-29244c64563c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:27 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1 Apr 15 13:39:27 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Flow 'volume_create_manager' (4c4a0b92-a69d-4b25-a570-bae10c11645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf442e0-95b1-4210-b409-42c5f5ac410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf442e0-95b1-4210-b409-42c5f5ac410f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1372760690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efae384d-8643-4e79-8a7d-f33d3d953fa8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5db6e3b26791454298fd0b3c4bc50cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:28Z,use_quota=True,user_id='206ab20ce3dd4495a5deb24f1661e69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504b22eb-6e07-4d4b-b264-9ed0e0ddc4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504b22eb-6e07-4d4b-b264-9ed0e0ddc4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e66810-aa2e-40c8-94dd-1a0b5758d465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e66810-aa2e-40c8-94dd-1a0b5758d465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efae384d-8643-4e79-8a7d-f33d3d953fa8', 'volume_name': 'volume-efae384d-8643-4e79-8a7d-f33d3d953fa8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9760b213-2ecb-4e21-a896-d04de7e4c5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9760b213-2ecb-4e21-a896-d04de7e4c5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ff0bba-03e5-43e1-9aff-c36bfbd90984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:28 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Volume efae384d-8643-4e79-8a7d-f33d3d953fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efae384d-8643-4e79-8a7d-f33d3d953fa8', 'volume_size': 1} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1372760690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efae384d-8643-4e79-8a7d-f33d3d953fa8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5db6e3b26791454298fd0b3c4bc50cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:28Z,use_quota=True,user_id='206ab20ce3dd4495a5deb24f1661e69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Creating volume efae384d-8643-4e79-8a7d-f33d3d953fa8 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:28 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:28 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8 1073741824 Apr 15 13:39:28 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:28 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1" returned: 0 in 0.500s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:28 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1 Apr 15 13:39:28 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:28 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8 1073741824" returned: 0 in 0.482s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:28 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8 Apr 15 13:39:28 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:28 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-eea596d6-4de6-4184-9423-aad835e76ad1" returned: 0 in 0.441s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-eea596d6-4de6-4184-9423-aad835e76ad1" released by "delete_volume" :: held 0.983s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created reservations ['65c9c5a5-96cf-4a8b-a5f3-709a43e7e35a', '93c17abb-3f5c-4c97-a2ec-15a9c77a7a98', '3c84cb9e-ce7b-42e1-8da6-4e58787bb0b5', 'b1008a6e-095c-45f1-9442-10346adb9465'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:28 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:28 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:29 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8" returned: 0 in 0.443s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ff0bba-03e5-43e1-9aff-c36bfbd90984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efae384d-8643-4e79-8a7d-f33d3d953fa8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989fca47-09a3-4f1c-ad8f-6e0a2fb9dda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:29 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Volume volume-efae384d-8643-4e79-8a7d-f33d3d953fa8 (efae384d-8643-4e79-8a7d-f33d3d953fa8): created successfully Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989fca47-09a3-4f1c-ad8f-6e0a2fb9dda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Flow 'volume_create_manager' (4c4a0b92-a69d-4b25-a570-bae10c11645e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:29 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-13bc0982-8705-452f-a18f-dc69d5911093 tempest-VolumesListTestJSON-440136330 None] Created volume successfully. Apr 15 13:39:29 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.422s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:29 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Deleted volume successfully. Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-18ac97e3-1c81-40fd-a25e-4132108b39a5 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-eea596d6-4de6-4184-9423-aad835e76ad1-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-c82063ec-91ea-42d7-a6a9-227df36705c7-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-c82063ec-91ea-42d7-a6a9-227df36705c7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-quobyte-c82063ec-91ea-42d7-a6a9-227df36705c7" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-c82063ec-91ea-42d7-a6a9-227df36705c7" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b91eff1-6e56-4ddf-b5ee-5e8f08ca99c1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:29 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7 Apr 15 13:39:29 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:30 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7" returned: 0 in 0.543s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:30 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7 Apr 15 13:39:30 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:30 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c82063ec-91ea-42d7-a6a9-227df36705c7" returned: 0 in 0.405s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-c82063ec-91ea-42d7-a6a9-227df36705c7" released by "delete_volume" :: held 0.970s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created reservations ['6629c012-5f6a-430a-9b7d-44a1d23a2fa4', 'f361c718-7367-4dde-9ba4-1d3b4743ee96', 'e55277f5-c415-4eec-87f5-cbcfc3213a06', '63342985-d2f7-4793-b37b-778e2d5fbb8d'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:30 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:30 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:31 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.442s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:31 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:31 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Deleted volume successfully. Apr 15 13:39:31 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-130e7477-f6b9-4b64-b0c8-a1dd0575714a tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-c82063ec-91ea-42d7-a6a9-227df36705c7-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:31 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-884fef15-e516-4885-9505-f65cc02171f8-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:31 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-884fef15-e516-4885-9505-f65cc02171f8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-quobyte-884fef15-e516-4885-9505-f65cc02171f8" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-884fef15-e516-4885-9505-f65cc02171f8" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd8fc2-1a29-485d-bfd9-537ef56d3e9c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:32 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8 Apr 15 13:39:32 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "cinder-efae384d-8643-4e79-8a7d-f33d3d953fa8-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-efae384d-8643-4e79-8a7d-f33d3d953fa8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "cinder-quobyte-efae384d-8643-4e79-8a7d-f33d3d953fa8" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-quobyte-efae384d-8643-4e79-8a7d-f33d3d953fa8" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc695863-8afa-4ef6-9a42-260b826d3a7a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:32 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8 Apr 15 13:39:32 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:32 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8" returned: 0 in 0.514s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:32 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8 Apr 15 13:39:32 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:32 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:32 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8 Apr 15 13:39:32 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:32 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-884fef15-e516-4885-9505-f65cc02171f8" returned: 0 in 0.426s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-884fef15-e516-4885-9505-f65cc02171f8" released by "delete_volume" :: held 0.970s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created reservations ['9c013bc2-af30-45cd-a3c3-37aceb355fd9', 'dcdb12bb-e614-465d-8188-21a4863c2ffd', '34762850-66b8-40a3-b140-76df463b6e36', '364693a5-5d48-4c3a-80fc-e5b3d2f6d558'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=124,cinder:INSERT=46,cinder:UPDATE=163,cinder:DELETE=13 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:33 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:33 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-4368f69d-fbdd-4ceb-872e-86fe11e50bf9-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-4368f69d-fbdd-4ceb-872e-86fe11e50bf9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-quobyte-4368f69d-fbdd-4ceb-872e-86fe11e50bf9" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-4368f69d-fbdd-4ceb-872e-86fe11e50bf9" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d65fff-9de3-4700-81cc-967de29d5ee6]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:33 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9 Apr 15 13:39:33 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:33 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-efae384d-8643-4e79-8a7d-f33d3d953fa8" returned: 0 in 0.446s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-quobyte-efae384d-8643-4e79-8a7d-f33d3d953fa8" released by "delete_volume" :: held 0.949s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Created reservations ['56dbbc27-9e54-4ff5-b37c-cf7837b84924', 'd95a1eff-8149-4f55-8fea-2b2824f01de4', '1d73f43f-a962-4f90-ae17-ba464343a407', 'd639178f-3dd2-4c61-abfa-1a9a08f56f27'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:33 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:33 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_service.periodic_task [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82595) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:33 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:33 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "cinder-53f530fe-c039-40e2-a322-ac66245ba16d-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-53f530fe-c039-40e2-a322-ac66245ba16d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "cinder-quobyte-53f530fe-c039-40e2-a322-ac66245ba16d" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:33 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-quobyte-53f530fe-c039-40e2-a322-ac66245ba16d" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:33 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Deleted volume successfully. Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e8e38e-e1be-466d-995e-8467adbb18f7]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-9da32686-09e6-4f07-8bae-7b7ed1113bf2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-884fef15-e516-4885-9505-f65cc02171f8-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:33 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d Apr 15 13:39:33 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:33 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9" returned: 0 in 0.523s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:33 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9 Apr 15 13:39:33 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:33 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.544s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:33 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Deleted volume successfully. Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0a149ae1-0664-4f99-8a97-d2eccfb6c4e4 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-efae384d-8643-4e79-8a7d-f33d3d953fa8-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:33 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.521s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:33 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:34 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d" returned: 0 in 0.510s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:34 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d Apr 15 13:39:34 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:34 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4368f69d-fbdd-4ceb-872e-86fe11e50bf9" returned: 0 in 0.426s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-4368f69d-fbdd-4ceb-872e-86fe11e50bf9" released by "delete_volume" :: held 0.971s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created reservations ['59dee85c-4388-44c1-98e1-5fbc568c884e', 'ff49eae5-cb6c-4244-bba7-7c5612f2360b', '02568ca6-7eaa-41d3-ab31-2234a78f973e', '343cdb5a-55b4-4368-a925-d39ff4c7ade1'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:34 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:34 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-202fafc0-e449-4dc1-94f5-e11199349fb4-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-202fafc0-e449-4dc1-94f5-e11199349fb4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-quobyte-202fafc0-e449-4dc1-94f5-e11199349fb4" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-202fafc0-e449-4dc1-94f5-e11199349fb4" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[337fa496-b727-4344-ba18-e3e7f38156af]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:34 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4 Apr 15 13:39:34 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:34 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-53f530fe-c039-40e2-a322-ac66245ba16d" returned: 0 in 0.424s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-quobyte-53f530fe-c039-40e2-a322-ac66245ba16d" released by "delete_volume" :: held 0.960s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Created reservations ['b9e373fe-308a-436e-a4a7-78542d057856', '06e9b5d2-14d1-4d06-a1c1-245d6f21cff9', '0497534c-ecf9-4b84-b56f-309fc4764304', '49bae56d-8cd2-4057-9a92-4513abc16516'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:34 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:34 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:34 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.451s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:34 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Deleted volume successfully. Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-730caa25-6359-416a-9b33-de388c7398b9 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-4368f69d-fbdd-4ceb-872e-86fe11e50bf9-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "cinder-937c626c-5be0-4540-8540-febf16a48f3b-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-937c626c-5be0-4540-8540-febf16a48f3b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "cinder-quobyte-937c626c-5be0-4540-8540-febf16a48f3b" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-quobyte-937c626c-5be0-4540-8540-febf16a48f3b" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c261bb4-e15b-40ff-ad5b-4cded7a191e3]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:34 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4" returned: 0 in 0.525s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:34 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b Apr 15 13:39:34 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4 Apr 15 13:39:34 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:34 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:35 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.497s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:35 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Deleted volume successfully. Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7f30515c-f6d3-4a74-90e4-6749418f1868 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-53f530fe-c039-40e2-a322-ac66245ba16d-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:35 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b" returned: 0 in 0.474s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:35 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b Apr 15 13:39:35 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:35 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-202fafc0-e449-4dc1-94f5-e11199349fb4" returned: 0 in 0.471s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-202fafc0-e449-4dc1-94f5-e11199349fb4" released by "delete_volume" :: held 1.019s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created reservations ['0d683036-a8c0-4356-b9e2-64820c1bb776', 'd4fa781c-668b-4a5e-972c-072389222630', '76d4c01a-2333-4401-ab07-ec40aa1ca5c8', '36d7e71e-ce29-4849-8f95-4a9abac51379'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:35 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:35 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:35 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-937c626c-5be0-4540-8540-febf16a48f3b" returned: 0 in 0.420s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-quobyte-937c626c-5be0-4540-8540-febf16a48f3b" released by "delete_volume" :: held 0.917s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Created reservations ['fce3f2dd-340a-40aa-a44c-04ad186dd1c1', 'efc0d72e-8c24-4220-9539-356bff6a172e', '9baa4682-caa8-46ab-8db1-405ac8160178', '88de4730-e169-404c-86fe-8ab8c11c3176'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:35 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:35 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:35 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.444s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:35 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Deleted volume successfully. Apr 15 13:39:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-cebdbaa7-4a7c-4bd1-a407-bc4fd9ee5ed2 tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-202fafc0-e449-4dc1-94f5-e11199349fb4-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:36 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.503s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:36 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Deleted volume successfully. Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3ffac2c8-5931-4509-8e0e-da7e62e4c3e1 tempest-VolumesListTestJSON-440136330 None] Lock "cinder-937c626c-5be0-4540-8540-febf16a48f3b-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-3d9bb012-ddaf-410e-b865-b01dc8098f90-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-3d9bb012-ddaf-410e-b865-b01dc8098f90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-quobyte-cf254b61-7219-4521-90d0-07ea740f7c1b" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-cf254b61-7219-4521-90d0-07ea740f7c1b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-quobyte-3d9bb012-ddaf-410e-b865-b01dc8098f90" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-3d9bb012-ddaf-410e-b865-b01dc8098f90" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Deleting offline snapshot 3d9bb012-ddaf-410e-b865-b01dc8098f90 of volume cf254b61-7219-4521-90d0-07ea740f7c1b {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] snapshot_file for this snap is: volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8278b77-9668-401f-8770-d1f82abde14f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:36 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 Apr 15 13:39:36 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:36 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90" returned: 0 in 0.533s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf254b61-7219-4521-90d0-07ea740f7c1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[d004afaa-ac1d-4304-8469-0b201717a43f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:37 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b Apr 15 13:39:37 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=153,cinder:UPDATE=201,cinder:INSERT=52,cinder:DELETE=22 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Flow 'volume_create_manager' (1b319e3d-8df3-47bb-8b12-4ac64d850116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ee2339-9f92-4943-b9c6-61ebe1b60bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ee2339-9f92-4943-b9c6-61ebe1b60bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2085695720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057dac29-4c4b-43be-9619-1d3d81619a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7775c29167cd449c946581bf60cf032d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:37Z,use_quota=True,user_id='6661e044fc3c4f81b0fa320e1da0a15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c75d99-215c-4c37-a243-c0ac6ca6481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c75d99-215c-4c37-a243-c0ac6ca6481c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845d62a8-83c3-4c4e-8068-416ae59b254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:37 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845d62a8-83c3-4c4e-8068-416ae59b254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '057dac29-4c4b-43be-9619-1d3d81619a7a', 'volume_name': 'volume-057dac29-4c4b-43be-9619-1d3d81619a7a', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9576a4f-ffb6-4090-bd0a-3fd3edb61796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9576a4f-ffb6-4090-bd0a-3fd3edb61796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0523b7fe-f91c-4b08-a003-6fbc187fe25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:37 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Volume 057dac29-4c4b-43be-9619-1d3d81619a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-057dac29-4c4b-43be-9619-1d3d81619a7a', 'volume_size': 1} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2085695720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057dac29-4c4b-43be-9619-1d3d81619a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7775c29167cd449c946581bf60cf032d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:37Z,use_quota=True,user_id='6661e044fc3c4f81b0fa320e1da0a15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Creating volume 057dac29-4c4b-43be-9619-1d3d81619a7a {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:37 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b" returned: 0 in 0.554s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:37 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a 1073741824 Apr 15 13:39:37 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:37 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 Apr 15 13:39:37 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:38 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:38 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a 1073741824" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90" returned: 0 in 0.482s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:38 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90 Apr 15 13:39:38 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:38 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a Apr 15 13:39:38 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:38 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a" returned: 0 in 0.414s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0523b7fe-f91c-4b08-a003-6fbc187fe25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-057dac29-4c4b-43be-9619-1d3d81619a7a', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6ce804-03bc-45d7-ae16-46f3100304b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:38 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Volume volume-057dac29-4c4b-43be-9619-1d3d81619a7a (057dac29-4c4b-43be-9619-1d3d81619a7a): created successfully Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6ce804-03bc-45d7-ae16-46f3100304b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:38 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Flow 'volume_create_manager' (1b319e3d-8df3-47bb-8b12-4ac64d850116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b.3d9bb012-ddaf-410e-b865-b01dc8098f90" returned: 0 in 0.470s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:38 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0bc75db8-5d05-4011-8497-8620fae145cb tempest-VolumesNegativeTest-1293889948 None] Created volume successfully. Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-3d9bb012-ddaf-410e-b865-b01dc8098f90" released by "_delete_snapshot" :: held 2.110s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-cf254b61-7219-4521-90d0-07ea740f7c1b" released by "delete_snapshot" :: held 2.122s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created reservations ['711a5936-a3d1-45d0-9582-ebd0865b0d98', 'e668af7d-b937-4364-a85a-307bd5858ad1', '1c011f3b-6721-43bd-8583-af625f936a8a', '48b20c61-2372-4511-94e7-437b01ab2158'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:38 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Delete snapshot completed successfully. Apr 15 13:39:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a7f24951-59f5-43d0-aad8-e9bf599c276e tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-3d9bb012-ddaf-410e-b865-b01dc8098f90-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-cf254b61-7219-4521-90d0-07ea740f7c1b-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-cf254b61-7219-4521-90d0-07ea740f7c1b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "cinder-quobyte-cf254b61-7219-4521-90d0-07ea740f7c1b" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-cf254b61-7219-4521-90d0-07ea740f7c1b" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:39 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[be858083-9052-4297-ba7e-1f3001b83b06]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:39 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b Apr 15 13:39:39 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:40 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b" returned: 0 in 0.538s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:40 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b Apr 15 13:39:40 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:40 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-cf254b61-7219-4521-90d0-07ea740f7c1b" returned: 0 in 0.412s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-quobyte-cf254b61-7219-4521-90d0-07ea740f7c1b" released by "delete_volume" :: held 0.993s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Created reservations ['edc376b5-bedd-4e75-94c5-2f2572f65e69', '513636de-ca96-408a-8d43-61e16bf66ac7', '368e0cf1-9686-4d3d-9e69-9a56b2c27542', '0e985f7c-8e9a-4304-9a48-3a28df90feda'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:40 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:40 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:41 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.410s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:41 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:41 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Deleted volume successfully. Apr 15 13:39:41 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-6747c64b-3e02-40e2-9253-84e51ae6c3ee tempest-CreateVolumesFromSnapshotTest-1143831402 None] Lock "cinder-cf254b61-7219-4521-90d0-07ea740f7c1b-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Flow 'volume_create_manager' (3b74a3e3-e0ae-4a65-87d7-a9910f5bb7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145f3130-db0f-4c35-80ef-33cbd8286555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145f3130-db0f-4c35-80ef-33cbd8286555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1461913641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2749404d-fdf6-4b91-b700-6cd924f721b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='737883fe91044e4b9255c21e6d8f6de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:43Z,use_quota=True,user_id='d31ff8aa35df4207984f3b9b09f363f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7298df-39da-4bc5-8daf-b65a30807d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7298df-39da-4bc5-8daf-b65a30807d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752e35f7-f16a-4b69-934a-980f651e6c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752e35f7-f16a-4b69-934a-980f651e6c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2749404d-fdf6-4b91-b700-6cd924f721b8', 'volume_name': 'volume-2749404d-fdf6-4b91-b700-6cd924f721b8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9e990a-d5c6-42ba-b2f2-f4a55c0fe087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9e990a-d5c6-42ba-b2f2-f4a55c0fe087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4e7b0b-251d-4e6c-88c2-b66a0b41c099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:43 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Volume 2749404d-fdf6-4b91-b700-6cd924f721b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2749404d-fdf6-4b91-b700-6cd924f721b8', 'volume_size': 1} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1461913641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2749404d-fdf6-4b91-b700-6cd924f721b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='737883fe91044e4b9255c21e6d8f6de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:43Z,use_quota=True,user_id='d31ff8aa35df4207984f3b9b09f363f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Creating volume 2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:43 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:43 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 1073741824 Apr 15 13:39:43 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:44 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 1073741824" returned: 0 in 0.480s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:44 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 Apr 15 13:39:44 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:44 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8" returned: 0 in 0.432s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4e7b0b-251d-4e6c-88c2-b66a0b41c099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2749404d-fdf6-4b91-b700-6cd924f721b8', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f660c448-6aee-4cf1-9223-1ab9cb4d1597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:44 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Volume volume-2749404d-fdf6-4b91-b700-6cd924f721b8 (2749404d-fdf6-4b91-b700-6cd924f721b8): created successfully Apr 15 13:39:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f660c448-6aee-4cf1-9223-1ab9cb4d1597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:44 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Flow 'volume_create_manager' (3b74a3e3-e0ae-4a65-87d7-a9910f5bb7ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:44 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-ff922f8b-8e00-4c77-acc4-25840288481e tempest-VolumeDependencyTests-1040278890 None] Created volume successfully. Apr 15 13:39:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Creating offline snapshot 2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 of volume 2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:39:45 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ee7304-7b3f-46b5-a0f4-45dd15d803e5]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:45 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 Apr 15 13:39:45 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:46 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8" returned: 0 in 0.504s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:46 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 1G Apr 15 13:39:46 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:46 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 1G" returned: 0 in 0.534s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2749404d-fdf6-4b91-b700-6cd924f721b8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:46 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2749404d-fdf6-4b91-b700-6cd924f721b8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 Apr 15 13:39:46 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:47 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2749404d-fdf6-4b91-b700-6cd924f721b8 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8" returned: 0 in 0.423s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:47 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 is being set with open permissions: ugo+rw Apr 15 13:39:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:47 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 Apr 15 13:39:47 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:47 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8" returned: 0 in 0.435s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:47 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.info Apr 15 13:39:47 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:48 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.info" returned: 0 in 0.438s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:48 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.info is being set with open permissions: ugo+rw Apr 15 13:39:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:48 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.info Apr 15 13:39:48 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:48 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.info" returned: 0 in 0.410s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.806s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:48 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-fe092f71-1fe1-4241-8fdb-6ac2d390915b tempest-VolumeDependencyTests-1040278890 None] Create snapshot completed successfully Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Flow 'volume_create_manager' (61773a16-5f58-4772-a895-e877ae35851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a26d33-5c0d-4084-b353-58d1815e96a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a26d33-5c0d-4084-b353-58d1815e96a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1756613549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2bbcf5-5853-4522-b76c-7317bce4ee62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='737883fe91044e4b9255c21e6d8f6de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2c1fec07-0197-4fe6-92bc-8a564e0bcbf8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:49Z,use_quota=True,user_id='d31ff8aa35df4207984f3b9b09f363f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fba639-259b-48f5-9854-e9d2d3a98b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fba639-259b-48f5-9854-e9d2d3a98b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e264c734-bed7-4bf4-9c6f-21550616f2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e264c734-bed7-4bf4-9c6f-21550616f2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a2bbcf5-5853-4522-b76c-7317bce4ee62', 'volume_name': 'volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62', 'volume_size': 1, 'snapshot_id': '2c1fec07-0197-4fe6-92bc-8a564e0bcbf8'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba935cbe-4b7d-4d87-bdee-2c73d14059a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba935cbe-4b7d-4d87-bdee-2c73d14059a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398a8a1c-0bab-4182-8eed-df6e64b1dd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:49 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Volume 8a2bbcf5-5853-4522-b76c-7317bce4ee62: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62', 'volume_size': 1, 'snapshot_id': '2c1fec07-0197-4fe6-92bc-8a564e0bcbf8'} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-quobyte-2c1fec07-0197-4fe6-92bc-8a564e0bcbf8-8a2bbcf5-5853-4522-b76c-7317bce4ee62" by "_create_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-2c1fec07-0197-4fe6-92bc-8a564e0bcbf8-8a2bbcf5-5853-4522-b76c-7317bce4ee62" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Creating volume 8a2bbcf5-5853-4522-b76c-7317bce4ee62 from snapshot 2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 {{(pid=82595) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-quobyte-8a2bbcf5-5853-4522-b76c-7317bce4ee62" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-8a2bbcf5-5853-4522-b76c-7317bce4ee62" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] snapshot: 2c1fec07-0197-4fe6-92bc-8a564e0bcbf8, volume: 8a2bbcf5-5853-4522-b76c-7317bce4ee62, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4c8ed0-bb69-4be9-a569-e2ca86655f53]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:49 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 Apr 15 13:39:49 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:49 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8" returned: 0 in 0.458s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2749404d-fdf6-4b91-b700-6cd924f721b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[032806a2-5c8a-448c-b56d-92e1d3d9722f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:49 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 Apr 15 13:39:49 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:50 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8" returned: 0 in 0.497s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:50 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:39:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:50 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 Apr 15 13:39:50 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:52 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62" returned: 0 in 2.645s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:52 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ab91bd-1062-42fc-b572-305e8267aff3]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:52 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 Apr 15 13:39:52 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:53 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8" returned: 0 in 0.645s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:53 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8, size 1024.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:39:53 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Converted 1024.00 MB image at 386.84 MB/s Apr 15 13:39:53 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 is being set with open permissions: ugo+rw Apr 15 13:39:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:53 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 Apr 15 13:39:53 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:53 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62" returned: 0 in 0.420s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-8a2bbcf5-5853-4522-b76c-7317bce4ee62" released by "_copy_volume_from_snapshot" :: held 4.729s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-2c1fec07-0197-4fe6-92bc-8a564e0bcbf8-8a2bbcf5-5853-4522-b76c-7317bce4ee62" released by "_create_volume_from_snapshot" :: held 4.747s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.756s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398a8a1c-0bab-4182-8eed-df6e64b1dd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62', 'volume_size': 1, 'snapshot_id': '2c1fec07-0197-4fe6-92bc-8a564e0bcbf8'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:53 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9241e20-7066-4cbf-a80c-734782ed2076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:54 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Volume volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 (8a2bbcf5-5853-4522-b76c-7317bce4ee62): created successfully Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9241e20-7066-4cbf-a80c-734782ed2076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Flow 'volume_create_manager' (61773a16-5f58-4772-a895-e877ae35851f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:54 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-3971f656-e397-4c33-bb47-e4b2ce7b4dfb tempest-VolumeDependencyTests-1040278890 None] Created volume successfully. Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-2c1fec07-0197-4fe6-92bc-8a564e0bcbf8-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-2c1fec07-0197-4fe6-92bc-8a564e0bcbf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-quobyte-2749404d-fdf6-4b91-b700-6cd924f721b8" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-2749404d-fdf6-4b91-b700-6cd924f721b8" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-quobyte-2c1fec07-0197-4fe6-92bc-8a564e0bcbf8" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-2c1fec07-0197-4fe6-92bc-8a564e0bcbf8" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Deleting offline snapshot 2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 of volume 2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] snapshot_file for this snap is: volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcaddac-8ed9-45ff-9fc9-40d13f9cea31]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:54 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 Apr 15 13:39:54 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:55 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8" returned: 0 in 0.512s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2749404d-fdf6-4b91-b700-6cd924f721b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:39:55 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3e5ab4-b5db-44ff-8621-226530545db9]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:55 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 Apr 15 13:39:55 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:55 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:55 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 Apr 15 13:39:55 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:56 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8" returned: 0 in 0.495s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:56 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8 Apr 15 13:39:56 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:56 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8.2c1fec07-0197-4fe6-92bc-8a564e0bcbf8" returned: 0 in 0.413s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-2c1fec07-0197-4fe6-92bc-8a564e0bcbf8" released by "_delete_snapshot" :: held 1.975s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-2749404d-fdf6-4b91-b700-6cd924f721b8" released by "delete_snapshot" :: held 1.984s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Created reservations ['dc93760d-1457-446b-a3b8-0d61f9ea2b15', '02612a4b-eec3-4746-82c7-aeea4a8c78d0', '4833a0cf-ea0b-4f23-9290-d46a9b3ab9b9', '55e1e49b-cb08-4451-bc15-d5841dfe3dc8'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:56 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Delete snapshot completed successfully. Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2cb3a262-f5ef-46c9-ab47-826f809c1ece tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-2c1fec07-0197-4fe6-92bc-8a564e0bcbf8-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-2749404d-fdf6-4b91-b700-6cd924f721b8-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-2749404d-fdf6-4b91-b700-6cd924f721b8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-quobyte-2749404d-fdf6-4b91-b700-6cd924f721b8" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:39:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-2749404d-fdf6-4b91-b700-6cd924f721b8" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:39:57 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1d7a6c-7d8e-4b7d-9bf3-c20293139e7f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:39:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:57 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 Apr 15 13:39:57 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:57 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:57 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8 Apr 15 13:39:57 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:57 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2749404d-fdf6-4b91-b700-6cd924f721b8" returned: 0 in 0.422s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-2749404d-fdf6-4b91-b700-6cd924f721b8" released by "delete_volume" :: held 0.946s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:57 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Created reservations ['d0e3ad17-bfd9-4324-8d5b-a138022f1134', 'c16990ad-356b-421d-b5aa-812016ff6b8f', 'b51f111c-ad9c-4175-9a84-af8511ee4045', 'e33415b6-d948-4899-b305-60d0bea673c4'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:58 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:39:58 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Flow 'volume_create_manager' (247d5d2d-9925-4c84-8cba-124f7dc6e709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ab3139-2a79-49e9-83fe-78c19c35959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ab3139-2a79-49e9-83fe-78c19c35959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-455686524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595b9eda-552a-4014-96d6-c959322de23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='737883fe91044e4b9255c21e6d8f6de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:58Z,use_quota=True,user_id='d31ff8aa35df4207984f3b9b09f363f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55abac6d-0dec-434f-b802-ca78aac8c801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55abac6d-0dec-434f-b802-ca78aac8c801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f004c421-057a-4635-a76a-e1771a4aa36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f004c421-057a-4635-a76a-e1771a4aa36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595b9eda-552a-4014-96d6-c959322de23f', 'volume_name': 'volume-595b9eda-552a-4014-96d6-c959322de23f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8405909-a45b-4ade-8517-f512020b7e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8405909-a45b-4ade-8517-f512020b7e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e47173-9139-430b-af0a-61c3f9078f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:58 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Volume 595b9eda-552a-4014-96d6-c959322de23f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595b9eda-552a-4014-96d6-c959322de23f', 'volume_size': 1} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-455686524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595b9eda-552a-4014-96d6-c959322de23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='737883fe91044e4b9255c21e6d8f6de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:39:58Z,use_quota=True,user_id='d31ff8aa35df4207984f3b9b09f363f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Creating volume 595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:39:58 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:58 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f 1073741824 Apr 15 13:39:58 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:58 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.454s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:39:58 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Deleted volume successfully. Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7ee438d5-1683-420f-a69f-95367098e1b6 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-2749404d-fdf6-4b91-b700-6cd924f721b8-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:39:58 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f 1073741824" returned: 0 in 0.500s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:39:58 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f Apr 15 13:39:58 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:39:59 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 15 13:39:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f" returned: 0 in 0.445s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:39:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:39:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:39:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e47173-9139-430b-af0a-61c3f9078f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595b9eda-552a-4014-96d6-c959322de23f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5f433d-ac91-48a6-87d5-ee8c83c2d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:39:59 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Volume volume-595b9eda-552a-4014-96d6-c959322de23f (595b9eda-552a-4014-96d6-c959322de23f): created successfully Apr 15 13:39:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5f433d-ac91-48a6-87d5-ee8c83c2d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:39:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Flow 'volume_create_manager' (247d5d2d-9925-4c84-8cba-124f7dc6e709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:39:59 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-48904912-3ce5-4a40-8018-08912f0db607 tempest-VolumeDependencyTests-1040278890 None] Created volume successfully. Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Flow 'volume_create_manager' (9ca01060-359c-40ba-b052-c249327c43ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebd383a-44da-4c02-8acc-3efb17c57949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebd383a-44da-4c02-8acc-3efb17c57949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-457339968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02000a1c-4ebe-4205-aca0-70e83aa22f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='737883fe91044e4b9255c21e6d8f6de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=595b9eda-552a-4014-96d6-c959322de23f,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:01Z,use_quota=True,user_id='d31ff8aa35df4207984f3b9b09f363f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2399951f-7054-4ef3-af99-9b8230deeff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2399951f-7054-4ef3-af99-9b8230deeff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79669900-f2f1-40ac-b2a3-b73e7b7559db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79669900-f2f1-40ac-b2a3-b73e7b7559db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '02000a1c-4ebe-4205-aca0-70e83aa22f3c', 'volume_name': 'volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c', 'volume_size': 1, 'source_volid': '595b9eda-552a-4014-96d6-c959322de23f', 'source_volstatus': 'available'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1db31b-0b0c-488d-868c-53595d08b911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1db31b-0b0c-488d-868c-53595d08b911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d8bab4-8c7d-4e7f-8b7a-9d7ce26590d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:00 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Volume 02000a1c-4ebe-4205-aca0-70e83aa22f3c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c', 'volume_size': 1, 'source_volid': '595b9eda-552a-4014-96d6-c959322de23f', 'source_volstatus': 'available'} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:00 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Cloning volume 595b9eda-552a-4014-96d6-c959322de23f to volume 02000a1c-4ebe-4205-aca0-70e83aa22f3c Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Creating offline snapshot b5e4df49-a0da-495e-b9d4-3d030040e079 of volume 595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5764ff4e-7b7d-478a-b39e-769c289b2de7]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:00 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f Apr 15 13:40:00 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:01 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f" returned: 0 in 0.532s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:01 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 1G Apr 15 13:40:01 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:01 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 1G" returned: 0 in 0.519s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595b9eda-552a-4014-96d6-c959322de23f -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:01 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595b9eda-552a-4014-96d6-c959322de23f -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 Apr 15 13:40:01 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:02 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595b9eda-552a-4014-96d6-c959322de23f -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079" returned: 0 in 0.480s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:02 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 is being set with open permissions: ugo+rw Apr 15 13:40:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:02 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 Apr 15 13:40:02 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:02 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079" returned: 0 in 0.473s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:02 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.info Apr 15 13:40:02 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Acquiring lock "cinder-057dac29-4c4b-43be-9619-1d3d81619a7a-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:03 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.info" returned: 0 in 0.432s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:03 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.info is being set with open permissions: ugo+rw Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Lock "cinder-057dac29-4c4b-43be-9619-1d3d81619a7a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:03 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.info Apr 15 13:40:03 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Acquiring lock "cinder-quobyte-057dac29-4c4b-43be-9619-1d3d81619a7a" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Lock "cinder-quobyte-057dac29-4c4b-43be-9619-1d3d81619a7a" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cf747a-d07e-4c0b-a8a7-561f705286bb]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:03 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a Apr 15 13:40:03 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:03 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.info" returned: 0 in 0.424s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-quobyte-02000a1c-4ebe-4205-aca0-70e83aa22f3c" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-02000a1c-4ebe-4205-aca0-70e83aa22f3c" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] snapshot: b5e4df49-a0da-495e-b9d4-3d030040e079, volume: 02000a1c-4ebe-4205-aca0-70e83aa22f3c, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[62253de1-8fc6-4981-aabf-e5bb058fc5ef]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:03 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 Apr 15 13:40:03 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:03 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:03 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a Apr 15 13:40:03 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:04 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079" returned: 0 in 0.480s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-595b9eda-552a-4014-96d6-c959322de23f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cf0c72-fcb2-4c66-9fbe-bd9da7a6224f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:04 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-057dac29-4c4b-43be-9619-1d3d81619a7a" returned: 0 in 0.416s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Lock "cinder-quobyte-057dac29-4c4b-43be-9619-1d3d81619a7a" released by "delete_volume" :: held 0.929s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Created reservations ['8aa341f2-2394-4def-961a-30f49fa0282b', 'f63d97e4-2b99-4189-97c2-66d889979c95', '493929d4-def5-4301-8c79-42a4d425899e', '8a3ffee3-7de1-44e4-bae8-4371e1f7d32d'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:04 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f Apr 15 13:40:04 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:04 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:40:04 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:04 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f" returned: 0 in 0.535s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:04 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c Apr 15 13:40:04 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:04 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.464s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:40:04 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Deleted volume successfully. Apr 15 13:40:04 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-30f74e36-717e-40ba-9d77-38138527a286 tempest-VolumesNegativeTest-1293889948 None] Lock "cinder-057dac29-4c4b-43be-9619-1d3d81619a7a-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:06 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c" returned: 0 in 2.202s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:06 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06b6617-93d1-4b68-b216-17b62c89d53d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:07 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f Apr 15 13:40:07 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:07 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f" returned: 0 in 0.658s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:07 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:40:07 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Converted 1024.00 MB image at 464.79 MB/s Apr 15 13:40:07 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c is being set with open permissions: ugo+rw Apr 15 13:40:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:07 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c Apr 15 13:40:07 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:08 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c" returned: 0 in 0.489s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-02000a1c-4ebe-4205-aca0-70e83aa22f3c" released by "_copy_volume_from_snapshot" :: held 4.413s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-quobyte-b5e4df49-a0da-495e-b9d4-3d030040e079" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-b5e4df49-a0da-495e-b9d4-3d030040e079" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Deleting offline snapshot b5e4df49-a0da-495e-b9d4-3d030040e079 of volume 595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] snapshot_file for this snap is: volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b34455-1b5b-4377-ace0-01b1f8cde3e6]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:08 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 Apr 15 13:40:08 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:08 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079" returned: 0 in 0.502s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-595b9eda-552a-4014-96d6-c959322de23f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dab221c-b94a-4c73-bf9f-5b8a333a34b2]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:08 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f Apr 15 13:40:08 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:09 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f" returned: 0 in 0.538s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:09 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 Apr 15 13:40:09 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:09 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079" returned: 0 in 0.541s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:09 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079 Apr 15 13:40:09 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:10 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f.b5e4df49-a0da-495e-b9d4-3d030040e079" returned: 0 in 0.429s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-b5e4df49-a0da-495e-b9d4-3d030040e079" released by "_delete_snapshot" :: held 2.057s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.452s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d8bab4-8c7d-4e7f-8b7a-9d7ce26590d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c', 'volume_size': 1, 'source_volid': '595b9eda-552a-4014-96d6-c959322de23f', 'source_volstatus': 'available'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fea5620-63e5-41c1-a3da-eeffe18aef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:10 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Volume volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c (02000a1c-4ebe-4205-aca0-70e83aa22f3c): created successfully Apr 15 13:40:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fea5620-63e5-41c1-a3da-eeffe18aef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:10 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Flow 'volume_create_manager' (9ca01060-359c-40ba-b052-c249327c43ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:10 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-028811f3-019f-451f-b8fa-368e7eb536a5 tempest-VolumeDependencyTests-1040278890 None] Created volume successfully. Apr 15 13:40:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-595b9eda-552a-4014-96d6-c959322de23f-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-595b9eda-552a-4014-96d6-c959322de23f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-quobyte-595b9eda-552a-4014-96d6-c959322de23f" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-595b9eda-552a-4014-96d6-c959322de23f" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:11 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[2421f0f9-799c-4364-8652-5c085b33cf55]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:11 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f Apr 15 13:40:11 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:11 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f" returned: 0 in 0.581s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:12 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f Apr 15 13:40:12 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Flow 'volume_create_manager' (a92470d1-cb86-4dff-9ceb-18bbe5e405e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7ff088-c373-4dac-9707-f9d13e92b77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7ff088-c373-4dac-9707-f9d13e92b77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-671451810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b752fd-f8ec-4d47-a437-fcc44e42b557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301701454d82462093aee7705db56351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:12Z,use_quota=True,user_id='852f0f7afd824e63bd21095384a37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d1d059-4ece-4cf0-98e3-b5c6bcb8ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d1d059-4ece-4cf0-98e3-b5c6bcb8ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31244e1e-2a53-4bc4-931c-2accb2f90482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31244e1e-2a53-4bc4-931c-2accb2f90482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b752fd-f8ec-4d47-a437-fcc44e42b557', 'volume_name': 'volume-10b752fd-f8ec-4d47-a437-fcc44e42b557', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0d64c5-a315-49d2-9d05-3191e470c38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0d64c5-a315-49d2-9d05-3191e470c38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc1a77f-0487-4e41-85f9-f38499f02981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:12 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Volume 10b752fd-f8ec-4d47-a437-fcc44e42b557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b752fd-f8ec-4d47-a437-fcc44e42b557', 'volume_size': 1} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-671451810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b752fd-f8ec-4d47-a437-fcc44e42b557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301701454d82462093aee7705db56351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:12Z,use_quota=True,user_id='852f0f7afd824e63bd21095384a37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Creating volume 10b752fd-f8ec-4d47-a437-fcc44e42b557 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:40:12 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:12 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-595b9eda-552a-4014-96d6-c959322de23f" returned: 0 in 0.494s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:12 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 1073741824 Apr 15 13:40:12 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-595b9eda-552a-4014-96d6-c959322de23f" released by "delete_volume" :: held 1.108s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Created reservations ['cad02272-5f5a-47dd-ae07-701f9bf019d6', '04e2f71f-f235-4420-b074-b925ad2d16f6', '844c9e1b-aed2-45b4-882b-8752d0fe2803', '94710366-a97a-4e1e-8184-f61296f2018e'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:12 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:40:12 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:12 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 1073741824" returned: 0 in 0.493s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:13 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.432s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:40:13 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 Apr 15 13:40:13 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:13 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Deleted volume successfully. Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-11737e16-1f2d-4bd6-ba6e-52a32ae176bf tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-595b9eda-552a-4014-96d6-c959322de23f-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:13 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557" returned: 0 in 0.427s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc1a77f-0487-4e41-85f9-f38499f02981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b752fd-f8ec-4d47-a437-fcc44e42b557', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72663fa4-bb7d-41a9-89e0-104179e1fe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:13 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Volume volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 (10b752fd-f8ec-4d47-a437-fcc44e42b557): created successfully Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72663fa4-bb7d-41a9-89e0-104179e1fe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Flow 'volume_create_manager' (a92470d1-cb86-4dff-9ceb-18bbe5e405e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-02000a1c-4ebe-4205-aca0-70e83aa22f3c-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:13 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-75d1427b-e9f3-43e3-b23b-bce757ab1d40 tempest-VolumesSnapshotTestJSON-1720273350 None] Created volume successfully. Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-02000a1c-4ebe-4205-aca0-70e83aa22f3c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-quobyte-02000a1c-4ebe-4205-aca0-70e83aa22f3c" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-02000a1c-4ebe-4205-aca0-70e83aa22f3c" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaaecd1-aaa5-48d5-893d-63281c5c651a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:13 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c Apr 15 13:40:13 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:13 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c" returned: 0 in 0.470s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:14 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c Apr 15 13:40:14 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:14 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-02000a1c-4ebe-4205-aca0-70e83aa22f3c" returned: 0 in 0.400s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-02000a1c-4ebe-4205-aca0-70e83aa22f3c" released by "delete_volume" :: held 0.893s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Created reservations ['0b30fbfc-ab3a-40cc-ab57-7e5697360263', '142aa9c1-2a2c-4448-9405-53b8881fecb6', '32cf3b57-06cb-46d8-b440-8fd988dee86c', '455c0062-3c6e-4c27-90f6-2fbd0bffa364'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:14 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:40:14 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-8a2bbcf5-5853-4522-b76c-7317bce4ee62-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-8a2bbcf5-5853-4522-b76c-7317bce4ee62-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "cinder-quobyte-8a2bbcf5-5853-4522-b76c-7317bce4ee62" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-8a2bbcf5-5853-4522-b76c-7317bce4ee62" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a31af8d-9de2-43ba-ae15-30d9ebd4f13a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Creating offline snapshot 22e60174-28ed-468d-96d9-32fc59deda34 of volume 10b752fd-f8ec-4d47-a437-fcc44e42b557 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ae1c2a-436a-4d6e-a958-e9f53d1fd2bd]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:14 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 Apr 15 13:40:14 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:14 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 Apr 15 13:40:14 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:14 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.467s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:40:14 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Deleted volume successfully. Apr 15 13:40:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2ece4c10-5142-4077-92a5-0039c59cec6d tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-02000a1c-4ebe-4205-aca0-70e83aa22f3c-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:15 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62" returned: 0 in 0.487s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:15 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62 Apr 15 13:40:15 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:15 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557" returned: 0 in 0.480s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:15 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 1G Apr 15 13:40:15 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:15 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-8a2bbcf5-5853-4522-b76c-7317bce4ee62" returned: 0 in 0.423s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-quobyte-8a2bbcf5-5853-4522-b76c-7317bce4ee62" released by "delete_volume" :: held 0.935s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Created reservations ['a4d0b378-6bd4-4e9c-85c4-5d659c6f3635', 'b01d31fb-b161-412f-984c-dc1b89ae552e', '4a653de8-c9cb-4458-9dc4-7a43e09bfdbf', '7cf84d99-f7e8-4163-b450-fcfb38f795cc'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:15 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 1G" returned: 0 in 0.500s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:15 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:40:15 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:15 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 Apr 15 13:40:15 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:16 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.493s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:16 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:40:16 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Deleted volume successfully. Apr 15 13:40:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-670a5d13-796b-4b6e-b6ab-50c49ea4d117 tempest-VolumeDependencyTests-1040278890 None] Lock "cinder-8a2bbcf5-5853-4522-b76c-7317bce4ee62-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:16 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34" returned: 0 in 0.515s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:16 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 is being set with open permissions: ugo+rw Apr 15 13:40:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:16 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 Apr 15 13:40:16 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:16 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34" returned: 0 in 0.490s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:16 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.info Apr 15 13:40:16 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:17 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.info" returned: 0 in 0.423s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:17 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.info is being set with open permissions: ugo+rw Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:17 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.info Apr 15 13:40:17 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:17 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.info" returned: 0 in 0.404s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.893s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:17 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b4ab6bf9-f25b-414f-8e2f-e7de235227ef tempest-VolumesSnapshotTestJSON-1720273350 None] Create snapshot completed successfully Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-22e60174-28ed-468d-96d9-32fc59deda34-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-22e60174-28ed-468d-96d9-32fc59deda34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-10b752fd-f8ec-4d47-a437-fcc44e42b557" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-10b752fd-f8ec-4d47-a437-fcc44e42b557" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-22e60174-28ed-468d-96d9-32fc59deda34" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-22e60174-28ed-468d-96d9-32fc59deda34" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Deleting offline snapshot 22e60174-28ed-468d-96d9-32fc59deda34 of volume 10b752fd-f8ec-4d47-a437-fcc44e42b557 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] snapshot_file for this snap is: volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f92df3-1f7d-482a-80cf-a01d3db43e3b]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:18 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 Apr 15 13:40:18 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:18 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10b752fd-f8ec-4d47-a437-fcc44e42b557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:40:18 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38aee0f-93e4-43ac-840b-f5c1eee1f4b7]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:18 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 Apr 15 13:40:18 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:18 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557" returned: 0 in 0.455s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:18 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 Apr 15 13:40:18 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:19 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34" returned: 0 in 0.449s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:19 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34 Apr 15 13:40:19 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:19 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557.22e60174-28ed-468d-96d9-32fc59deda34" returned: 0 in 0.396s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-22e60174-28ed-468d-96d9-32fc59deda34" released by "_delete_snapshot" :: held 1.822s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-10b752fd-f8ec-4d47-a437-fcc44e42b557" released by "delete_snapshot" :: held 1.832s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:19 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Created reservations ['e8d38a39-07da-44ca-aeeb-32065e8e275b', '51855a33-3a81-42a3-81c7-32b53490837f', '2e93e8d2-f128-4b45-9810-aa80e15c6729', '44770d48-ca7e-4138-904d-0c1a45c99360'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:19 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Delete snapshot completed successfully. Apr 15 13:40:19 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-21f25ead-68d5-4b24-84bf-168b3187e475 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-22e60174-28ed-468d-96d9-32fc59deda34-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Flow 'volume_create_manager' (3225f731-4eea-42e9-848f-dae29ace727e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935e4046-4405-4f52-8e83-f70966852a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935e4046-4405-4f52-8e83-f70966852a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1139454658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c223b2a-1b89-49e6-bc2b-a3daae226ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301701454d82462093aee7705db56351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:20Z,use_quota=True,user_id='852f0f7afd824e63bd21095384a37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f832e097-4ffe-44f7-ac9b-6ec638a7cdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f832e097-4ffe-44f7-ac9b-6ec638a7cdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e07a220-3bac-4b9c-a9cc-61d5bbe4539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e07a220-3bac-4b9c-a9cc-61d5bbe4539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c223b2a-1b89-49e6-bc2b-a3daae226ce6', 'volume_name': 'volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3509f2f2-fe59-428a-9d6d-2163753767fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3509f2f2-fe59-428a-9d6d-2163753767fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ebb69d-8caf-4b59-869a-5f308a5f51e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:20 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Volume 2c223b2a-1b89-49e6-bc2b-a3daae226ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6', 'volume_size': 1} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1139454658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c223b2a-1b89-49e6-bc2b-a3daae226ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301701454d82462093aee7705db56351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:20Z,use_quota=True,user_id='852f0f7afd824e63bd21095384a37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Creating volume 2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:40:20 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:20 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 1073741824 Apr 15 13:40:20 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:20 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 1073741824" returned: 0 in 0.459s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:20 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 Apr 15 13:40:20 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:21 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" returned: 0 in 0.406s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ebb69d-8caf-4b59-869a-5f308a5f51e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b855e5ee-161d-4b68-acab-b7e66e3078f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Volume volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 (2c223b2a-1b89-49e6-bc2b-a3daae226ce6): created successfully Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b855e5ee-161d-4b68-acab-b7e66e3078f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Flow 'volume_create_manager' (3225f731-4eea-42e9-848f-dae29ace727e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-91d9e6c7-3b29-4864-8a09-7203f6a8d6cc tempest-VolumesSnapshotTestJSON-1720273350 None] Created volume successfully. Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Creating offline snapshot f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b of volume 2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4997a8b3-14ab-47df-8333-370cd62a2653]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:21 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 Apr 15 13:40:21 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:21 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" returned: 0 in 0.451s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:21 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b 1G Apr 15 13:40:21 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:22 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b 1G" returned: 0 in 0.467s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:22 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b Apr 15 13:40:22 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:22 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b" returned: 0 in 0.413s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:22 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b is being set with open permissions: ugo+rw Apr 15 13:40:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:22 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b Apr 15 13:40:22 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:23 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b" returned: 0 in 0.406s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:23 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.info Apr 15 13:40:23 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:23 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.info" returned: 0 in 0.425s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:23 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.info is being set with open permissions: ugo+rw Apr 15 13:40:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:23 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.info Apr 15 13:40:23 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:24 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.info" returned: 0 in 0.412s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:24 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-6b970a35-f227-472a-a81f-8bafa6a84df0 tempest-VolumesSnapshotTestJSON-1720273350 None] Create snapshot completed successfully Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Flow 'volume_create_manager' (e7343b6f-b396-4ad0-bd15-7ee8dfb1ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d9bd52-9ff8-43c6-967c-0b59fcdf0614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d9bd52-9ff8-43c6-967c-0b59fcdf0614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-650668552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10233370-bf48-469e-8f30-ca78095339de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301701454d82462093aee7705db56351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:25Z,use_quota=True,user_id='852f0f7afd824e63bd21095384a37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0defed42-1bc8-4264-84ad-dd8387b7c7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0defed42-1bc8-4264-84ad-dd8387b7c7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59530473-1487-49ce-9fe4-2ece5f023faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59530473-1487-49ce-9fe4-2ece5f023faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '10233370-bf48-469e-8f30-ca78095339de', 'volume_name': 'volume-10233370-bf48-469e-8f30-ca78095339de', 'volume_size': 2, 'snapshot_id': 'f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2d1c3c-cdf5-4514-9789-dfae3e081dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2d1c3c-cdf5-4514-9789-dfae3e081dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce8055b-8a8f-4638-abfc-bd17f017ed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:24 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Volume 10233370-bf48-469e-8f30-ca78095339de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-10233370-bf48-469e-8f30-ca78095339de', 'volume_size': 2, 'snapshot_id': 'f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b'} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b-10233370-bf48-469e-8f30-ca78095339de" by "_create_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b-10233370-bf48-469e-8f30-ca78095339de" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Creating volume 10233370-bf48-469e-8f30-ca78095339de from snapshot f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b {{(pid=82595) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-10233370-bf48-469e-8f30-ca78095339de" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-10233370-bf48-469e-8f30-ca78095339de" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] snapshot: f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b, volume: 10233370-bf48-469e-8f30-ca78095339de, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[deba3df4-cac3-4c85-9c92-6470082a12c4]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:24 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b Apr 15 13:40:24 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:25 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:40:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:40:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:40:25 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e1b292-13d7-42fe-b435-8be189be1247]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:25 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 Apr 15 13:40:25 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:25 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" returned: 0 in 0.471s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:25 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:40:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:25 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de Apr 15 13:40:25 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:27 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de" returned: 0 in 1.959s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:27 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f7d718-cc50-4178-8035-20c10371d3a4]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:27 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 Apr 15 13:40:27 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:28 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" returned: 0 in 0.614s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:40:28 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Converted 1024.00 MB image at 522.46 MB/s Apr 15 13:40:28 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de is being set with open permissions: ugo+rw Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:28 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de Apr 15 13:40:28 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:28 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de" returned: 0 in 0.405s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-10233370-bf48-469e-8f30-ca78095339de" released by "_copy_volume_from_snapshot" :: held 3.976s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b-10233370-bf48-469e-8f30-ca78095339de" released by "_create_volume_from_snapshot" :: held 3.994s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.002s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce8055b-8a8f-4638-abfc-bd17f017ed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10233370-bf48-469e-8f30-ca78095339de', 'volume_size': 2, 'snapshot_id': 'f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8caf8d-cad3-438a-97c3-19a43296b788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:28 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Volume volume-10233370-bf48-469e-8f30-ca78095339de (10233370-bf48-469e-8f30-ca78095339de): created successfully Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8caf8d-cad3-438a-97c3-19a43296b788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Flow 'volume_create_manager' (e7343b6f-b396-4ad0-bd15-7ee8dfb1ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:28 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-3fbf8ca1-6e40-4509-9c54-d0ea3e2b5c35 tempest-VolumesSnapshotTestJSON-1720273350 None] Created volume successfully. Apr 15 13:40:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-10233370-bf48-469e-8f30-ca78095339de-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-10233370-bf48-469e-8f30-ca78095339de-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-10233370-bf48-469e-8f30-ca78095339de" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-10233370-bf48-469e-8f30-ca78095339de" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:29 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f03d718-f3cd-4ec4-918e-b091a5b32f81]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:29 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de Apr 15 13:40:29 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:29 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de" returned: 0 in 0.462s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:29 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de Apr 15 13:40:29 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:29 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10233370-bf48-469e-8f30-ca78095339de" returned: 0 in 0.397s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-10233370-bf48-469e-8f30-ca78095339de" released by "delete_volume" :: held 0.890s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Created reservations ['c17de115-df5e-4b69-bf4c-d154e857b35a', 'c5dbda4e-2a8f-470b-82b2-5a16450c9c27', '35d17a40-705a-4ff5-b4d3-56949cccb3a8', '4640f772-7ca5-4fbd-b014-873fef7b395d'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:30 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:40:30 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Deleting offline snapshot f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b of volume 2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] snapshot_file for this snap is: volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c750a-ea1f-46e3-8a72-38f275a16549]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:30 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b Apr 15 13:40:30 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:30 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.414s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:40:30 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Deleted volume successfully. Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dac3aa39-17ca-45ec-9b12-2759ee1b6672 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-10233370-bf48-469e-8f30-ca78095339de-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:30 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b" returned: 0 in 0.473s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d8cb4a-5f20-4d5b-88fd-f838af1a81da]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:30 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 Apr 15 13:40:30 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:31 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:31 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b Apr 15 13:40:31 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:31 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b" returned: 0 in 0.446s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:31 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b Apr 15 13:40:31 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:32 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6.f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b" returned: 0 in 0.416s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b" released by "_delete_snapshot" :: held 1.861s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" released by "delete_snapshot" :: held 1.876s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Created reservations ['8434a46d-7c08-4f74-86e5-274be2b0e2ea', '02b5ba99-a4fb-44d2-a051-cd978863c727', 'f812b25e-6e06-4876-a7bf-9856dbce47fc', '846466b8-392e-4ed8-9e71-1378242bd9f2'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:32 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Delete snapshot completed successfully. Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-56e1261e-537a-4c43-9e93-c895b549c14c tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-f1d2ff20-23dc-4451-a27c-ca8a50b7cf1b-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-2c223b2a-1b89-49e6-bc2b-a3daae226ce6-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-2c223b2a-1b89-49e6-bc2b-a3daae226ce6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[690d6989-5858-4d75-bd09-a2c27f3401f9]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:32 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 Apr 15 13:40:32 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:32 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:32 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6 Apr 15 13:40:32 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:33 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" returned: 0 in 0.414s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-2c223b2a-1b89-49e6-bc2b-a3daae226ce6" released by "delete_volume" :: held 0.917s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=110,cinder:UPDATE=154,cinder:INSERT=40,cinder:DELETE=12 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Created reservations ['b54bc397-2180-456d-bac6-ba7b9dee61d9', '73052b4c-a124-461f-91a9-557e0f9abf22', '756508db-6126-46ce-a6b4-4bd971a91c7d', '87e6f966-0669-4e12-a2af-8449d61029f0'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_service.periodic_task [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82595) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:33 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:40:33 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:33 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:40:33 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Flow 'volume_create_manager' (a62822c9-4292-4bd5-a48d-e00a2bb1f425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9b2103-05fe-4392-b4b3-8ad03ebc2d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9b2103-05fe-4392-b4b3-8ad03ebc2d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1088931287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b23795a-edf0-4249-bd64-9bf46d4e9ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301701454d82462093aee7705db56351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:34Z,use_quota=True,user_id='852f0f7afd824e63bd21095384a37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e707d4b3-01cd-4918-8762-b11d1808ad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e707d4b3-01cd-4918-8762-b11d1808ad4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f30fcd-b6d0-45a1-b81e-2f3e530f0be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f30fcd-b6d0-45a1-b81e-2f3e530f0be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b23795a-edf0-4249-bd64-9bf46d4e9ae5', 'volume_name': 'volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d90f13-8a13-4713-9586-7fc4b5eaa10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d90f13-8a13-4713-9586-7fc4b5eaa10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214c9f4c-f6bc-492a-9234-9c30cfd05336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:33 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Volume 1b23795a-edf0-4249-bd64-9bf46d4e9ae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5', 'volume_size': 1} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1088931287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b23795a-edf0-4249-bd64-9bf46d4e9ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301701454d82462093aee7705db56351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:34Z,use_quota=True,user_id='852f0f7afd824e63bd21095384a37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Creating volume 1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:40:33 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:33 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 1073741824 Apr 15 13:40:33 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:33 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.478s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:33 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.467s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:40:33 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Deleted volume successfully. Apr 15 13:40:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-34edaf0f-0218-4f78-8989-4ba2690f3afb tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-2c223b2a-1b89-49e6-bc2b-a3daae226ce6-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:34 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 1073741824" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:34 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 Apr 15 13:40:34 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:34 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" returned: 0 in 0.415s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:40:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:34 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214c9f4c-f6bc-492a-9234-9c30cfd05336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:34 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f24aca-e201-49f6-99d5-d3f0464d7dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:34 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Volume volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 (1b23795a-edf0-4249-bd64-9bf46d4e9ae5): created successfully Apr 15 13:40:34 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f24aca-e201-49f6-99d5-d3f0464d7dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:34 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Flow 'volume_create_manager' (a62822c9-4292-4bd5-a48d-e00a2bb1f425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:34 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-41c58353-69cb-4b2d-83e6-d1a245528a6f tempest-VolumesSnapshotTestJSON-1720273350 None] Created volume successfully. Apr 15 13:40:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Creating offline snapshot 72a1482b-800f-4070-9d6d-74fea0be0b1c of volume 1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:40:36 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7589d9-b744-4d0b-a965-fd7a510269cf]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:36 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 Apr 15 13:40:36 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:36 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" returned: 0 in 0.522s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:36 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c 1G Apr 15 13:40:36 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:37 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c 1G" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:37 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c Apr 15 13:40:37 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:37 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c" returned: 0 in 0.451s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:37 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c is being set with open permissions: ugo+rw Apr 15 13:40:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:37 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c Apr 15 13:40:37 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:37 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c" returned: 0 in 0.414s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:37 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:UPDATE=112,cinder:SELECT=112,cinder:INSERT=29,cinder:DELETE=7 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:40:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:37 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.info Apr 15 13:40:37 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:38 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.info" returned: 0 in 0.433s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:38 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.info is being set with open permissions: ugo+rw Apr 15 13:40:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:38 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.info Apr 15 13:40:38 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:38 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.info" returned: 0 in 0.409s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.769s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:38 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-3f749529-a8d6-4ee6-8767-a975ee4f46aa tempest-VolumesSnapshotTestJSON-1720273350 None] Create snapshot completed successfully Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Flow 'volume_create_manager' (b4313ec8-3c04-406b-8cf2-fda684afca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ffa5eb-9c98-4357-9d5f-56f1ebbef6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ffa5eb-9c98-4357-9d5f-56f1ebbef6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-388012517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58c5760-1c80-4e88-8b61-ed63cd6de1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301701454d82462093aee7705db56351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72a1482b-800f-4070-9d6d-74fea0be0b1c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:39Z,use_quota=True,user_id='852f0f7afd824e63bd21095384a37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679ecfb5-d2bb-4c03-b318-68c1b5b19b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679ecfb5-d2bb-4c03-b318-68c1b5b19b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb25c6eb-d5f6-416e-b782-38b5ad430101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb25c6eb-d5f6-416e-b782-38b5ad430101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b58c5760-1c80-4e88-8b61-ed63cd6de1f6', 'volume_name': 'volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6', 'volume_size': 1, 'snapshot_id': '72a1482b-800f-4070-9d6d-74fea0be0b1c'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb500af4-aeaf-49e0-9d4c-ab05cd9c0f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb500af4-aeaf-49e0-9d4c-ab05cd9c0f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3074774a-2a2a-487e-8380-b721222551ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:39 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Volume b58c5760-1c80-4e88-8b61-ed63cd6de1f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6', 'volume_size': 1, 'snapshot_id': '72a1482b-800f-4070-9d6d-74fea0be0b1c'} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-72a1482b-800f-4070-9d6d-74fea0be0b1c-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" by "_create_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-72a1482b-800f-4070-9d6d-74fea0be0b1c-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Creating volume b58c5760-1c80-4e88-8b61-ed63cd6de1f6 from snapshot 72a1482b-800f-4070-9d6d-74fea0be0b1c {{(pid=82595) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] snapshot: 72a1482b-800f-4070-9d6d-74fea0be0b1c, volume: b58c5760-1c80-4e88-8b61-ed63cd6de1f6, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84f6eac-7c09-46ac-8fc0-8ebaf6666d88]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:39 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c Apr 15 13:40:39 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:39 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c" returned: 0 in 0.475s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4293d841-876f-42b4-a8dc-8f4b734a3392]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:40 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 Apr 15 13:40:40 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:40 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" returned: 0 in 0.505s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:40 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:40:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:40 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 Apr 15 13:40:40 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:42 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" returned: 0 in 1.869s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:42 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5af984-b186-47f8-ba82-ed2d3b64fc71]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:42 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 Apr 15 13:40:42 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:42 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" returned: 0 in 0.596s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:42 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5, size 1024.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:40:42 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Converted 1024.00 MB image at 547.47 MB/s Apr 15 13:40:42 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 is being set with open permissions: ugo+rw Apr 15 13:40:42 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:43 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 Apr 15 13:40:43 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:43 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" returned: 0 in 0.423s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" released by "_copy_volume_from_snapshot" :: held 3.922s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-72a1482b-800f-4070-9d6d-74fea0be0b1c-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" released by "_create_volume_from_snapshot" :: held 3.938s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.946s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3074774a-2a2a-487e-8380-b721222551ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6', 'volume_size': 1, 'snapshot_id': '72a1482b-800f-4070-9d6d-74fea0be0b1c'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3c79b1-3d6a-48fd-a8cb-2cf7530a67c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:43 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Volume volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 (b58c5760-1c80-4e88-8b61-ed63cd6de1f6): created successfully Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3c79b1-3d6a-48fd-a8cb-2cf7530a67c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Flow 'volume_create_manager' (b4313ec8-3c04-406b-8cf2-fda684afca6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:43 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-4609ae1b-164d-4c77-8291-385236b156b3 tempest-VolumesSnapshotTestJSON-1720273350 None] Created volume successfully. Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-b58c5760-1c80-4e88-8b61-ed63cd6de1f6-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-b58c5760-1c80-4e88-8b61-ed63cd6de1f6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cee3510-e795-4e82-8d0c-bef0c484b5c7]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:43 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 Apr 15 13:40:43 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:44 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" returned: 0 in 0.517s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:44 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6 Apr 15 13:40:44 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:44 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" returned: 0 in 0.425s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-b58c5760-1c80-4e88-8b61-ed63cd6de1f6" released by "delete_volume" :: held 0.969s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Created reservations ['1398fad0-7948-4a52-a238-de70c4a25f8a', 'd77a88cc-516e-43dc-8508-114714b48bb6', 'cc9233be-c740-4ebd-9033-d95fc630acd2', '1eef920f-c8dc-4203-ad7f-de3ac06e9b68'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:44 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:40:44 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-72a1482b-800f-4070-9d6d-74fea0be0b1c-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-72a1482b-800f-4070-9d6d-74fea0be0b1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-72a1482b-800f-4070-9d6d-74fea0be0b1c" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-72a1482b-800f-4070-9d6d-74fea0be0b1c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Deleting offline snapshot 72a1482b-800f-4070-9d6d-74fea0be0b1c of volume 1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] snapshot_file for this snap is: volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf7f9e1-da1a-4386-8143-9143db4db132]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:44 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c Apr 15 13:40:44 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:45 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.428s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:45 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:40:45 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Deleted volume successfully. Apr 15 13:40:45 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-dff2eef6-b040-4338-a4e0-b8ea4b002cdd tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-b58c5760-1c80-4e88-8b61-ed63cd6de1f6-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:45 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c" returned: 0 in 0.485s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:40:45 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6593bf3-682c-4067-94cc-3793a815f33b]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:45 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 Apr 15 13:40:45 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:45 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:45 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c Apr 15 13:40:45 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:46 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c" returned: 0 in 0.461s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:46 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c Apr 15 13:40:46 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:46 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5.72a1482b-800f-4070-9d6d-74fea0be0b1c" returned: 0 in 0.406s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:46 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-72a1482b-800f-4070-9d6d-74fea0be0b1c" released by "_delete_snapshot" :: held 1.871s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:46 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" released by "delete_snapshot" :: held 1.882s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:46 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Created reservations ['9fc83c47-52f2-47b0-aa33-638f4088168d', '5db1ec5f-17d0-4622-975d-e47877253713', '58e2ddf0-52a4-442a-8891-00ff1c0923af', '2d8cb93c-728d-4841-b5d8-136b24b349a0'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:46 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Delete snapshot completed successfully. Apr 15 13:40:46 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8b87f6f6-1353-468f-9cf1-b1060fe63791 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-72a1482b-800f-4070-9d6d-74fea0be0b1c-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:46 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-1b23795a-edf0-4249-bd64-9bf46d4e9ae5-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-1b23795a-edf0-4249-bd64-9bf46d4e9ae5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:47 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a72803d-d2d5-4a43-ac4d-3705072a07c3]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:47 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 Apr 15 13:40:47 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:47 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" returned: 0 in 0.473s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:47 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5 Apr 15 13:40:47 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:47 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" returned: 0 in 0.414s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-1b23795a-edf0-4249-bd64-9bf46d4e9ae5" released by "delete_volume" :: held 0.919s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:47 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Created reservations ['44aa0362-f61c-445d-b6cf-02264179ae8c', '11a4d4fc-6ae8-4ea3-9811-559382eb10db', 'ec8a2a09-cf79-4876-9e1e-5f3d367beccb', '9446e802-4ee3-43b5-a867-23fbdc4931f0'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:48 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:40:48 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-10b752fd-f8ec-4d47-a437-fcc44e42b557-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-10b752fd-f8ec-4d47-a437-fcc44e42b557-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "cinder-quobyte-10b752fd-f8ec-4d47-a437-fcc44e42b557" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-10b752fd-f8ec-4d47-a437-fcc44e42b557" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3f10c8-1ab5-4c96-92ce-9001e5aef26a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:48 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 Apr 15 13:40:48 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:48 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.468s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:40:48 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Deleted volume successfully. Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-22bbefc3-d6ef-4d9e-8c31-6cd12ab50e9e tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-1b23795a-edf0-4249-bd64-9bf46d4e9ae5-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:48 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557" returned: 0 in 0.474s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:48 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557 Apr 15 13:40:48 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:49 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-10b752fd-f8ec-4d47-a437-fcc44e42b557" returned: 0 in 0.416s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-quobyte-10b752fd-f8ec-4d47-a437-fcc44e42b557" released by "delete_volume" :: held 0.918s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Created reservations ['ea6bd190-2b16-41df-b84f-6cde66b394ce', 'c8dd2ca3-47ee-4962-8b0a-6a1ccbeaaa50', 'c6f53f92-29f0-400d-9a1a-128307700dcb', '2acaa65f-d494-4dec-a336-1fbf8036b520'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:49 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:40:49 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:49 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.419s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:40:49 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Deleted volume successfully. Apr 15 13:40:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b8afe4b3-5082-4ea6-aa19-8043b2a04ec9 tempest-VolumesSnapshotTestJSON-1720273350 None] Lock "cinder-10b752fd-f8ec-4d47-a437-fcc44e42b557-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Flow 'volume_create_manager' (8d783391-7eba-45ec-911a-ec6626aebddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b550a3-fb74-4fd7-9e29-f5db281bdc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b550a3-fb74-4fd7-9e29-f5db281bdc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-464343986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97306009-7e64-46dc-b15f-a607ec3c8461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5884acb768414047b4d46fd321a2fe76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:58Z,use_quota=True,user_id='ea63608f2026468fb0a97d3521650e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44167e6-4c37-4d79-822d-908c69fb1fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44167e6-4c37-4d79-822d-908c69fb1fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e0a005-c2f3-463e-ac59-a442a8f65bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e0a005-c2f3-463e-ac59-a442a8f65bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97306009-7e64-46dc-b15f-a607ec3c8461', 'volume_name': 'volume-97306009-7e64-46dc-b15f-a607ec3c8461', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1187c9-92b8-4050-8cfb-5175af308c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1187c9-92b8-4050-8cfb-5175af308c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc775a9a-819e-4df6-b659-02e2f3f32512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Volume 97306009-7e64-46dc-b15f-a607ec3c8461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97306009-7e64-46dc-b15f-a607ec3c8461', 'volume_size': 1} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-464343986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97306009-7e64-46dc-b15f-a607ec3c8461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5884acb768414047b4d46fd321a2fe76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:58Z,use_quota=True,user_id='ea63608f2026468fb0a97d3521650e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Creating volume 97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:40:58 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:58 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 1073741824 Apr 15 13:40:58 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Flow 'volume_create_manager' (7dc32fb7-369c-4cef-b7ea-16964c4da2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2613cba8-b4f6-4fbc-8fa8-a31496575e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2613cba8-b4f6-4fbc-8fa8-a31496575e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786220839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34e8177-75c7-4cba-a1ce-d9ecdf631095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075ffc2a20b4f83a9b306ab24c8bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:58Z,use_quota=True,user_id='dc146034bbab4ebba20bfa9e1a58bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9c5b2a-937f-482c-8d7c-ff959e93088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9c5b2a-937f-482c-8d7c-ff959e93088e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a76293-b628-4715-b6dd-950c32f498cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a76293-b628-4715-b6dd-950c32f498cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34e8177-75c7-4cba-a1ce-d9ecdf631095', 'volume_name': 'volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac396864-532c-45e8-a540-a32f17f6b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac396864-532c-45e8-a540-a32f17f6b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616b00c7-7424-47f6-b482-0be601a1207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Volume a34e8177-75c7-4cba-a1ce-d9ecdf631095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095', 'volume_size': 1} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (dbf4f579-9011-4e35-be60-3a1a29345645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82cdec8-ed46-4dff-bc3f-47ab88965df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82cdec8-ed46-4dff-bc3f-47ab88965df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1681342748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a925aa-9749-4f2b-bed5-e01dca794a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:59Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac421de9-9890-4d85-98c8-c0eb20b0f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac421de9-9890-4d85-98c8-c0eb20b0f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146c172b-a6df-48ec-becd-a36a99825a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146c172b-a6df-48ec-becd-a36a99825a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a925aa-9749-4f2b-bed5-e01dca794a12', 'volume_name': 'volume-31a925aa-9749-4f2b-bed5-e01dca794a12', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c85813-6f83-4889-9e2f-f7d0ef5e60d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c85813-6f83-4889-9e2f-f7d0ef5e60d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e475cc-6c9c-4868-ab8e-72f587da6165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume 31a925aa-9749-4f2b-bed5-e01dca794a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a925aa-9749-4f2b-bed5-e01dca794a12', 'volume_size': 1} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Flow 'volume_create_manager' (6a8015d6-5149-4152-9f2e-2a039fa771cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e6be8c-22d2-4e95-8c5c-9bccff6ed915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e6be8c-22d2-4e95-8c5c-9bccff6ed915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-511923308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9c2781-bab6-4424-ad1d-94ef060bedf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075ffc2a20b4f83a9b306ab24c8bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:59Z,use_quota=True,user_id='dc146034bbab4ebba20bfa9e1a58bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913d4714-faab-4e62-bee3-d09a5771d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913d4714-faab-4e62-bee3-d09a5771d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8288fddd-e6cc-4a81-bae6-ea1dcb2e6bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8288fddd-e6cc-4a81-bae6-ea1dcb2e6bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9c2781-bab6-4424-ad1d-94ef060bedf1', 'volume_name': 'volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e6b776-d375-420a-b2de-942673bfdf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e6b776-d375-420a-b2de-942673bfdf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3e04e8-5a82-4bae-97e6-de148ed9a4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Volume 9f9c2781-bab6-4424-ad1d-94ef060bedf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1', 'volume_size': 1} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Flow 'volume_create_manager' (fc470123-a717-4b5c-9d0c-706546ea0c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a582ab-6eaf-46a4-9e64-fdfcb1561606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a582ab-6eaf-46a4-9e64-fdfcb1561606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542566973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99e1f2b-d1f2-4d84-815f-369245418127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075ffc2a20b4f83a9b306ab24c8bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:59Z,use_quota=True,user_id='dc146034bbab4ebba20bfa9e1a58bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37006bbf-2d31-4897-a274-bb26f1dd27f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37006bbf-2d31-4897-a274-bb26f1dd27f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a710f22b-632f-46d9-836a-e688d6e64a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a710f22b-632f-46d9-836a-e688d6e64a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b99e1f2b-d1f2-4d84-815f-369245418127', 'volume_name': 'volume-b99e1f2b-d1f2-4d84-815f-369245418127', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a6334c-3cf2-4a5a-96ee-1938a4b9ce05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a6334c-3cf2-4a5a-96ee-1938a4b9ce05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e785cc3b-7818-4ff1-9f8e-c8d34d72be4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:58 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Volume b99e1f2b-d1f2-4d84-815f-369245418127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b99e1f2b-d1f2-4d84-815f-369245418127', 'volume_size': 1} Apr 15 13:40:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Flow 'volume_create_manager' (47676e28-c278-4ba8-8a58-6f7cdcff017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9aab5a8-e924-430f-a0c3-46950ea04070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9aab5a8-e924-430f-a0c3-46950ea04070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1147977777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ddb516-427f-4418-a406-b0b35b29ba58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075ffc2a20b4f83a9b306ab24c8bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:59Z,use_quota=True,user_id='dc146034bbab4ebba20bfa9e1a58bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78be21d0-6cc8-472e-9c26-8f9fa9da3d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78be21d0-6cc8-472e-9c26-8f9fa9da3d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b34bc0e-8a8a-4f07-8356-034b808f16c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b34bc0e-8a8a-4f07-8356-034b808f16c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ddb516-427f-4418-a406-b0b35b29ba58', 'volume_name': 'volume-77ddb516-427f-4418-a406-b0b35b29ba58', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d072c798-e41e-4baa-b251-63e23d7aedec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d072c798-e41e-4baa-b251-63e23d7aedec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc8fe8e-cbf9-4fa3-ad3b-322d170eaf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Volume 77ddb516-427f-4418-a406-b0b35b29ba58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ddb516-427f-4418-a406-b0b35b29ba58', 'volume_size': 1} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:59 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 1073741824" returned: 0 in 0.769s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:59 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 Apr 15 13:40:59 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Flow 'volume_create_manager' (f2a6c486-f69a-45f9-9b2c-c0171acf5102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c8c278-ab77-4761-bc3f-c7cb73139d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c8c278-ab77-4761-bc3f-c7cb73139d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1847540255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c84a18-0d02-49f2-ba66-ed304ede338b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075ffc2a20b4f83a9b306ab24c8bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:59Z,use_quota=True,user_id='dc146034bbab4ebba20bfa9e1a58bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5e0e4d-21f3-4997-83f5-1ee3d7857e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5e0e4d-21f3-4997-83f5-1ee3d7857e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4d547e-043c-417e-88d0-ac0518f045b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4d547e-043c-417e-88d0-ac0518f045b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c84a18-0d02-49f2-ba66-ed304ede338b', 'volume_name': 'volume-78c84a18-0d02-49f2-ba66-ed304ede338b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e633caec-a567-440d-b1f3-72c94921dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e633caec-a567-440d-b1f3-72c94921dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e74fc51-8e9b-4015-ba09-59c384cc7020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Volume 78c84a18-0d02-49f2-ba66-ed304ede338b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c84a18-0d02-49f2-ba66-ed304ede338b', 'volume_size': 1} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:59 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461" returned: 0 in 0.452s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.092s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786220839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34e8177-75c7-4cba-a1ce-d9ecdf631095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075ffc2a20b4f83a9b306ab24c8bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:58Z,use_quota=True,user_id='dc146034bbab4ebba20bfa9e1a58bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Creating volume a34e8177-75c7-4cba-a1ce-d9ecdf631095 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:40:59 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc775a9a-819e-4df6-b659-02e2f3f32512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97306009-7e64-46dc-b15f-a607ec3c8461', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:59 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095 1073741824 Apr 15 13:40:59 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e14b606-0375-4f11-812e-6df3e292736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:40:59 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Volume volume-97306009-7e64-46dc-b15f-a607ec3c8461 (97306009-7e64-46dc-b15f-a607ec3c8461): created successfully Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e14b606-0375-4f11-812e-6df3e292736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:40:59 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Flow 'volume_create_manager' (8d783391-7eba-45ec-911a-ec6626aebddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:40:59 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-bfb68182-b9f2-4985-81d3-855370d99b35 tempest-VolumeDependencyTests-551675859 None] Created volume successfully. Apr 15 13:41:00 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095 1073741824" returned: 0 in 0.484s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:00 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095 Apr 15 13:41:00 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:00 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095" returned: 0 in 0.477s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.880s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1681342748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a925aa-9749-4f2b-bed5-e01dca794a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:59Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Creating volume 31a925aa-9749-4f2b-bed5-e01dca794a12 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:00 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:00 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 1073741824 Apr 15 13:41:00 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616b00c7-7424-47f6-b482-0be601a1207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a458423-a55c-4de2-b4dc-df4ba4afa0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:00 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Volume volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095 (a34e8177-75c7-4cba-a1ce-d9ecdf631095): created successfully Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a458423-a55c-4de2-b4dc-df4ba4afa0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:00 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Flow 'volume_create_manager' (7dc32fb7-369c-4cef-b7ea-16964c4da2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:00 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-8e234963-e010-4359-9594-0e33091650d7 tempest-CreateVolumesFromImageTest-492396519 None] Created volume successfully. Apr 15 13:41:01 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 1073741824" returned: 0 in 0.498s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:01 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 Apr 15 13:41:01 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:01 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12" returned: 0 in 0.445s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.735s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-511923308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9c2781-bab6-4424-ad1d-94ef060bedf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075ffc2a20b4f83a9b306ab24c8bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:59Z,use_quota=True,user_id='dc146034bbab4ebba20bfa9e1a58bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Creating volume 9f9c2781-bab6-4424-ad1d-94ef060bedf1 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:01 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e475cc-6c9c-4868-ab8e-72f587da6165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a925aa-9749-4f2b-bed5-e01dca794a12', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:01 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1 1073741824 Apr 15 13:41:01 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8d7982-638f-4fff-a89d-8ef3e92498f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:01 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume volume-31a925aa-9749-4f2b-bed5-e01dca794a12 (31a925aa-9749-4f2b-bed5-e01dca794a12): created successfully Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8d7982-638f-4fff-a89d-8ef3e92498f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (dbf4f579-9011-4e35-be60-3a1a29345645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:01 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-1d0bd5bb-5b35-4863-80f3-c1d7044317e9 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created volume successfully. Apr 15 13:41:01 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:02 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1 1073741824" returned: 0 in 0.511s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:02 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1 Apr 15 13:41:02 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:02 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1" returned: 0 in 0.459s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.652s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542566973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99e1f2b-d1f2-4d84-815f-369245418127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075ffc2a20b4f83a9b306ab24c8bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:59Z,use_quota=True,user_id='dc146034bbab4ebba20bfa9e1a58bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Creating volume b99e1f2b-d1f2-4d84-815f-369245418127 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:02 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3e04e8-5a82-4bae-97e6-de148ed9a4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99eccd9-1e38-4dc2-af36-adac0c1ea44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:02 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127 1073741824 Apr 15 13:41:02 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:02 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Volume volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1 (9f9c2781-bab6-4424-ad1d-94ef060bedf1): created successfully Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99eccd9-1e38-4dc2-af36-adac0c1ea44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:02 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Flow 'volume_create_manager' (6a8015d6-5149-4152-9f2e-2a039fa771cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:02 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e3c59bbf-0621-4ddd-8279-bd34af34f9f4 tempest-CreateVolumesFromImageTest-492396519 None] Created volume successfully. Apr 15 13:41:03 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127 1073741824" returned: 0 in 0.514s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:03 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127 Apr 15 13:41:03 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:03 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127" returned: 0 in 0.461s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.526s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1147977777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ddb516-427f-4418-a406-b0b35b29ba58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075ffc2a20b4f83a9b306ab24c8bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:59Z,use_quota=True,user_id='dc146034bbab4ebba20bfa9e1a58bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Creating volume 77ddb516-427f-4418-a406-b0b35b29ba58 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:03 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e785cc3b-7818-4ff1-9f8e-c8d34d72be4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b99e1f2b-d1f2-4d84-815f-369245418127', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e99e14-0ed3-4eb7-b74c-025e2f66bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:03 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58 1073741824 Apr 15 13:41:03 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:03 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Volume volume-b99e1f2b-d1f2-4d84-815f-369245418127 (b99e1f2b-d1f2-4d84-815f-369245418127): created successfully Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e99e14-0ed3-4eb7-b74c-025e2f66bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:03 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Flow 'volume_create_manager' (fc470123-a717-4b5c-9d0c-706546ea0c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:03 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-041aa9b1-6370-4509-989f-d16d482670f6 tempest-CreateVolumesFromImageTest-492396519 None] Created volume successfully. Apr 15 13:41:04 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58 1073741824" returned: 0 in 0.531s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:04 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58 Apr 15 13:41:04 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:04 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58" returned: 0 in 0.450s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.346s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1847540255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c84a18-0d02-49f2-ba66-ed304ede338b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075ffc2a20b4f83a9b306ab24c8bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:40:59Z,use_quota=True,user_id='dc146034bbab4ebba20bfa9e1a58bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Creating volume 78c84a18-0d02-49f2-ba66-ed304ede338b {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:04 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc8fe8e-cbf9-4fa3-ad3b-322d170eaf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ddb516-427f-4418-a406-b0b35b29ba58', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0868b91-c185-418d-8c6e-363b1fa2f869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:04 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b 1073741824 Apr 15 13:41:04 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:04 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Volume volume-77ddb516-427f-4418-a406-b0b35b29ba58 (77ddb516-427f-4418-a406-b0b35b29ba58): created successfully Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0868b91-c185-418d-8c6e-363b1fa2f869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:04 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Flow 'volume_create_manager' (47676e28-c278-4ba8-8a58-6f7cdcff017c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:04 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-1c188ac6-60c5-432c-90d1-cb25ed16874b tempest-CreateVolumesFromImageTest-492396519 None] Created volume successfully. Apr 15 13:41:05 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b 1073741824" returned: 0 in 0.536s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:05 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b Apr 15 13:41:05 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:05 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b" returned: 0 in 0.447s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.120s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e74fc51-8e9b-4015-ba09-59c384cc7020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c84a18-0d02-49f2-ba66-ed304ede338b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c000fb1e-dd70-43a0-8115-0159de30cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:05 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Volume volume-78c84a18-0d02-49f2-ba66-ed304ede338b (78c84a18-0d02-49f2-ba66-ed304ede338b): created successfully Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c000fb1e-dd70-43a0-8115-0159de30cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Flow 'volume_create_manager' (f2a6c486-f69a-45f9-9b2c-c0171acf5102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Creating offline snapshot 6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d of volume 97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:41:05 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c4144c50-3571-43e4-82a3-16139388046b tempest-CreateVolumesFromImageTest-492396519 None] Created volume successfully. Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7aa485-ea92-4ccd-ae63-170bb20fc502]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:05 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 Apr 15 13:41:05 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "cinder-78c84a18-0d02-49f2-ba66-ed304ede338b-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-78c84a18-0d02-49f2-ba66-ed304ede338b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "cinder-quobyte-78c84a18-0d02-49f2-ba66-ed304ede338b" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-quobyte-78c84a18-0d02-49f2-ba66-ed304ede338b" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c4bff-40c3-44e0-8e38-59f8c6399da1]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:05 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:05 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b Apr 15 13:41:05 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:06 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461" returned: 0 in 0.566s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:06 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d 1G Apr 15 13:41:06 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:06 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b" returned: 0 in 0.494s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:06 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b Apr 15 13:41:06 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:06 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d 1G" returned: 0 in 0.515s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97306009-7e64-46dc-b15f-a607ec3c8461 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:06 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97306009-7e64-46dc-b15f-a607ec3c8461 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d Apr 15 13:41:06 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:06 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-78c84a18-0d02-49f2-ba66-ed304ede338b" returned: 0 in 0.466s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-quobyte-78c84a18-0d02-49f2-ba66-ed304ede338b" released by "delete_volume" :: held 0.986s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Created reservations ['2986bd75-44fc-4687-9727-f3e4b1354d93', 'bedd5563-61c4-495f-9bd4-079c43d46126', '6a23e595-f210-4115-ba43-df74b11b67ea', '83c16b30-d84c-4f20-ba5c-2ff00f3db965'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:06 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:06 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:06 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:07 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97306009-7e64-46dc-b15f-a607ec3c8461 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d" returned: 0 in 0.479s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:07 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d is being set with open permissions: ugo+rw Apr 15 13:41:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:07 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d Apr 15 13:41:07 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:07 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.435s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:07 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:07 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Deleted volume successfully. Apr 15 13:41:07 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-511d3fc6-55aa-4991-904d-1b74c0d166c4 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-78c84a18-0d02-49f2-ba66-ed304ede338b-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:07 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d" returned: 0 in 0.458s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:07 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:07 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.info Apr 15 13:41:07 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "cinder-77ddb516-427f-4418-a406-b0b35b29ba58-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-77ddb516-427f-4418-a406-b0b35b29ba58-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "cinder-quobyte-77ddb516-427f-4418-a406-b0b35b29ba58" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-quobyte-77ddb516-427f-4418-a406-b0b35b29ba58" acquired by "delete_volume" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9d9ca3-5613-4c58-b466-701db65dae95]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:08 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58 Apr 15 13:41:08 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:08 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.info" returned: 0 in 0.468s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:08 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.info is being set with open permissions: ugo+rw Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:08 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.info Apr 15 13:41:08 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:08 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58" returned: 0 in 0.498s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:08 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58 Apr 15 13:41:08 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:08 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.info" returned: 0 in 0.432s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.023s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.784s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Creating offline snapshot 04fed66f-2305-41e7-8b3f-cd75d9edb0af of volume 31a925aa-9749-4f2b-bed5-e01dca794a12 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:41:08 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-bf32fd99-afd0-4e04-a87e-6912768ee137 tempest-VolumeDependencyTests-551675859 None] Create snapshot completed successfully Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6ade15-17ad-4f44-b32e-a852aee6570c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:08 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:08 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 Apr 15 13:41:08 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:09 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-77ddb516-427f-4418-a406-b0b35b29ba58" returned: 0 in 0.509s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-quobyte-77ddb516-427f-4418-a406-b0b35b29ba58" released by "delete_volume" :: held 1.043s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Created reservations ['a0b4dbee-d6a2-48a5-a303-5cc623ba435d', '741417f0-f7cd-45f6-aa0f-4548971b02b5', 'eaad4858-6fee-4d44-a819-005d027d8659', 'e3ed18ab-1621-4d4e-88ef-1b3740dac21c'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:09 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:09 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Flow 'volume_create_manager' (2756f2ae-e3ee-4cf8-895a-66f7e3fd819b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2300d86c-db32-49c1-b6d1-b49612d6b67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2300d86c-db32-49c1-b6d1-b49612d6b67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-785870892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8e509c-c34a-4130-a4d8-fa77df70ff2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5884acb768414047b4d46fd321a2fe76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:09Z,use_quota=True,user_id='ea63608f2026468fb0a97d3521650e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a05345a-fd1c-492b-9f04-f939336a6328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a05345a-fd1c-492b-9f04-f939336a6328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf52bfcb-0cd7-4f99-b1ff-8401053ad2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf52bfcb-0cd7-4f99-b1ff-8401053ad2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f8e509c-c34a-4130-a4d8-fa77df70ff2d', 'volume_name': 'volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d', 'volume_size': 1, 'snapshot_id': '6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd3af96-0f45-459d-8b8a-043e256f554c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd3af96-0f45-459d-8b8a-043e256f554c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e4d52a-057f-49b2-80ac-8f1f28697132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:09 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Volume 3f8e509c-c34a-4130-a4d8-fa77df70ff2d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d', 'volume_size': 1, 'snapshot_id': '6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d'} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:09 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12" returned: 0 in 0.839s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:09 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af 1G Apr 15 13:41:09 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:09 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.503s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:09 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Deleted volume successfully. Apr 15 13:41:09 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23ee0881-3087-41ec-a1eb-a50321ca75e6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-77ddb516-427f-4418-a406-b0b35b29ba58-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:10 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af 1G" returned: 0 in 0.583s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a925aa-9749-4f2b-bed5-e01dca794a12 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:10 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a925aa-9749-4f2b-bed5-e01dca794a12 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af Apr 15 13:41:10 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "cinder-b99e1f2b-d1f2-4d84-815f-369245418127-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-b99e1f2b-d1f2-4d84-815f-369245418127-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "cinder-quobyte-b99e1f2b-d1f2-4d84-815f-369245418127" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-quobyte-b99e1f2b-d1f2-4d84-815f-369245418127" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a39e41e-bbd2-4743-b497-2ce808863e00]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:10 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127 Apr 15 13:41:10 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:10 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a925aa-9749-4f2b-bed5-e01dca794a12 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af" returned: 0 in 0.577s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:10 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af is being set with open permissions: ugo+rw Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:10 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af Apr 15 13:41:10 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:10 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127" returned: 0 in 0.554s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:10 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:10 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127 Apr 15 13:41:10 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:11 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af" returned: 0 in 0.623s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:11 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.info Apr 15 13:41:11 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:11 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-b99e1f2b-d1f2-4d84-815f-369245418127" returned: 0 in 0.577s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-quobyte-b99e1f2b-d1f2-4d84-815f-369245418127" released by "delete_volume" :: held 1.166s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Created reservations ['5d2babbb-4ebd-45f6-ada2-b5165b37bb61', '6ce1d4f7-d347-46c7-95dd-870d9d3c5a30', '1382e611-37bc-4ebf-8030-8e52b7febadd', 'e8d9ef24-f415-4eec-98ac-27d2d0416866'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:11 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:11 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Flow 'volume_create_manager' (a0a7a746-1976-474b-9432-eb9c1b119445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87b9823-cb01-4f9c-aa78-f8bee08846e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87b9823-cb01-4f9c-aa78-f8bee08846e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1341102709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d50f4c-d036-47cf-822a-ef09cf269a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd309b60f1ae4a4d914b55892bdc5659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:12Z,use_quota=True,user_id='0177b48ecc1f4fc2be004e2de2974cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702e6cbc-6a27-4dd3-bf6f-5c22a806033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702e6cbc-6a27-4dd3-bf6f-5c22a806033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ca0df8-72f9-448d-9031-393aac56e34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ca0df8-72f9-448d-9031-393aac56e34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d50f4c-d036-47cf-822a-ef09cf269a32', 'volume_name': 'volume-03d50f4c-d036-47cf-822a-ef09cf269a32', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c3d267-94cf-433c-98b7-2ff2a4f215f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c3d267-94cf-433c-98b7-2ff2a4f215f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8559ae34-e122-4f81-b6ef-df468c83cb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:11 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Volume 03d50f4c-d036-47cf-822a-ef09cf269a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d50f4c-d036-47cf-822a-ef09cf269a32', 'volume_size': 1} Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:11 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.info" returned: 0 in 0.605s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:11 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.info is being set with open permissions: ugo+rw Apr 15 13:41:11 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:11 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.info Apr 15 13:41:11 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:12 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:12 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Deleted volume successfully. Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e1c4a997-4156-4d20-bbb9-26bd897582ca tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-b99e1f2b-d1f2-4d84-815f-369245418127-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:12 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.info" returned: 0 in 0.433s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.743s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.928s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-quobyte-6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" by "_create_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:12 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-9e6f0ff3-deb9-47e0-81be-5ac1c328758c tempest-CreateVolumesFromSnapshotTest-1686790138 None] Create snapshot completed successfully Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Creating volume 3f8e509c-c34a-4130-a4d8-fa77df70ff2d from snapshot 6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d {{(pid=82595) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-quobyte-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] snapshot: 6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d, volume: 3f8e509c-c34a-4130-a4d8-fa77df70ff2d, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded9e4c5-df08-4d9b-92f1-8e96b1d698e7]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "cinder-9f9c2781-bab6-4424-ad1d-94ef060bedf1-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-9f9c2781-bab6-4424-ad1d-94ef060bedf1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "cinder-quobyte-9f9c2781-bab6-4424-ad1d-94ef060bedf1" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-quobyte-9f9c2781-bab6-4424-ad1d-94ef060bedf1" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c70062a-11ec-4211-9a0a-50b101cdef32]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:12 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d Apr 15 13:41:12 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:12 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1 Apr 15 13:41:12 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:12 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d" returned: 0 in 0.501s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:12 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97306009-7e64-46dc-b15f-a607ec3c8461(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[24513aa1-15ef-43f8-b765-2a476e16837d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:13 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 Apr 15 13:41:13 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:13 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1" returned: 0 in 0.503s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:13 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1 Apr 15 13:41:13 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:13 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461" returned: 0 in 0.482s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:13 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d Apr 15 13:41:13 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:13 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (3c1523eb-11fd-445c-9acc-b5b6e842957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12a4be8-5078-4195-88d8-d09be477046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9f9c2781-bab6-4424-ad1d-94ef060bedf1" returned: 0 in 0.496s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-quobyte-9f9c2781-bab6-4424-ad1d-94ef060bedf1" released by "delete_volume" :: held 1.030s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12a4be8-5078-4195-88d8-d09be477046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093144305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6119a0-9678-4a13-8114-792042622ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:14Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5ce93c-9121-4637-aa85-ff07591673f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5ce93c-9121-4637-aa85-ff07591673f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10138abc-8f97-48c3-ba97-6f98e223a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10138abc-8f97-48c3-ba97-6f98e223a24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6119a0-9678-4a13-8114-792042622ebe', 'volume_name': 'volume-2f6119a0-9678-4a13-8114-792042622ebe', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe27164d-9253-44fd-83a5-52676dae0325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe27164d-9253-44fd-83a5-52676dae0325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11642712-02bd-4f02-a589-9a9da4d127af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume 2f6119a0-9678-4a13-8114-792042622ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6119a0-9678-4a13-8114-792042622ebe', 'volume_size': 1} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Created reservations ['586dd211-d0bb-48c7-9b69-3bf5bec37b31', 'd074bd1a-3b37-4be7-9cda-a0e3fa6ff0c2', 'c039be1d-5ecd-47a8-b9cd-8648ebb6a1a8', '1ee424ce-0ac5-4337-9c7c-523e945f0b14'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:13 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:13 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (9e6a5f42-a029-46e3-98ed-dc6ef6efdb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9e8a1f-9238-433c-9e1b-4357fe07eb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9e8a1f-9238-433c-9e1b-4357fe07eb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1424801517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958137d1-24a6-42e6-a694-2484d502ad4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:14Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa52cfd-15a9-49ae-8a0a-f40a7f02659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa52cfd-15a9-49ae-8a0a-f40a7f02659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed33e7c5-02fc-4366-8623-7daa38f24be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed33e7c5-02fc-4366-8623-7daa38f24be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958137d1-24a6-42e6-a694-2484d502ad4f', 'volume_name': 'volume-958137d1-24a6-42e6-a694-2484d502ad4f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1c373b-4aed-46b5-a605-6f7d96a58540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1c373b-4aed-46b5-a605-6f7d96a58540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff27bd7-ec8e-4320-bf64-c3b01d9f4432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume 958137d1-24a6-42e6-a694-2484d502ad4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958137d1-24a6-42e6-a694-2484d502ad4f', 'volume_size': 1} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (f1a47daf-1467-4bf9-a6e2-cd696e2ba166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8647312c-b96c-4387-be54-9717aec17c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8647312c-b96c-4387-be54-9717aec17c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1875556203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de65f30-3ad4-494b-9719-b80756516345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:14Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d38384-eceb-4f30-a514-929b85f28353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d38384-eceb-4f30-a514-929b85f28353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a29fac-58fe-42ff-ac6c-da9a3d6f0c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a29fac-58fe-42ff-ac6c-da9a3d6f0c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3de65f30-3ad4-494b-9719-b80756516345', 'volume_name': 'volume-3de65f30-3ad4-494b-9719-b80756516345', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85642691-fdfc-4445-92bb-c2fdb505400b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85642691-fdfc-4445-92bb-c2fdb505400b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ee892d-4cd5-41a5-a4d2-55eafd117d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:13 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume 3de65f30-3ad4-494b-9719-b80756516345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3de65f30-3ad4-494b-9719-b80756516345', 'volume_size': 1} Apr 15 13:41:13 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (927204f6-8c0e-4c4a-92d7-60b5afe966ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3478dd4-eab6-4fc2-aeb6-c9889d5ceea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3478dd4-eab6-4fc2-aeb6-c9889d5ceea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-818027526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84c1aca-a6df-4c20-8fd3-3473704d745b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:14Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b8644a-a6f9-4c0e-b15b-b4b8653da5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b8644a-a6f9-4c0e-b15b-b4b8653da5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5cec31-8b3f-4f02-99da-eae45a9e7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5cec31-8b3f-4f02-99da-eae45a9e7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c84c1aca-a6df-4c20-8fd3-3473704d745b', 'volume_name': 'volume-c84c1aca-a6df-4c20-8fd3-3473704d745b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc3ef30-c6e8-4c76-b1f5-184a97536503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc3ef30-c6e8-4c76-b1f5-184a97536503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a18bd4e-7d67-40f0-8f04-3c8297db68e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:14 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume c84c1aca-a6df-4c20-8fd3-3473704d745b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c84c1aca-a6df-4c20-8fd3-3473704d745b', 'volume_size': 1} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:14 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.994s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:14 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Deleted volume successfully. Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-214ad117-b692-4a8d-837c-6417d217a4a6 tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-9f9c2781-bab6-4424-ad1d-94ef060bedf1-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "cinder-a34e8177-75c7-4cba-a1ce-d9ecdf631095-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-a34e8177-75c7-4cba-a1ce-d9ecdf631095-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "cinder-quobyte-a34e8177-75c7-4cba-a1ce-d9ecdf631095" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-quobyte-a34e8177-75c7-4cba-a1ce-d9ecdf631095" acquired by "delete_volume" :: waited 0.023s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdfd626-0670-4a8a-b6ad-041605643fa5]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:14 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:15 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095 Apr 15 13:41:15 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (754890c3-58c9-4bc3-bbb6-134bcab4b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31e0c7e-dc70-4fef-b090-c06732cfadfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31e0c7e-dc70-4fef-b090-c06732cfadfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406708984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d9f61c-42f5-4fa3-b425-fc9448b0702b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:15Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84595b4f-cb8b-49c3-b1c8-feb30095c1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84595b4f-cb8b-49c3-b1c8-feb30095c1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47396242-634a-4785-a1f0-b876a5458252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47396242-634a-4785-a1f0-b876a5458252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d9f61c-42f5-4fa3-b425-fc9448b0702b', 'volume_name': 'volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c1096c-7a70-4c1b-b4e8-e2a701d076a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c1096c-7a70-4c1b-b4e8-e2a701d076a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0f8631-eeff-490b-9be2-f4790d59a807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:15 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume 91d9f61c-42f5-4fa3-b425-fc9448b0702b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b', 'volume_size': 1} Apr 15 13:41:15 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:16 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095" returned: 0 in 1.094s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:16 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095 Apr 15 13:41:16 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:16 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" returned: 0 in 2.557s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[565f6aa4-5ccd-4701-b301-8aa3d0c7416e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:16 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 Apr 15 13:41:16 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:16 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-a34e8177-75c7-4cba-a1ce-d9ecdf631095" returned: 0 in 0.439s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-quobyte-a34e8177-75c7-4cba-a1ce-d9ecdf631095" released by "delete_volume" :: held 1.563s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Created reservations ['0785a9ef-5eed-4db7-ada6-995586ea19c1', '1ae0e67e-f8ab-48b0-8109-29095cfeef9b', '42af310f-dcac-4465-becd-7aa7ce427db4', 'fcd0b1f6-7f72-4b99-942d-9baa1b3beb64'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:16 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:16 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:16 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461" returned: 0 in 0.634s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461, size 1024.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:41:16 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Converted 1024.00 MB image at 400.20 MB/s Apr 15 13:41:16 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d is being set with open permissions: ugo+rw Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:16 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d Apr 15 13:41:16 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:16 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.454s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:16 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:16 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Deleted volume successfully. Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-7bf3bc2c-3ad6-4175-93cd-1f4e2dbc821f tempest-CreateVolumesFromImageTest-492396519 None] Lock "cinder-a34e8177-75c7-4cba-a1ce-d9ecdf631095-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:17 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" returned: 0 in 0.462s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" released by "_copy_volume_from_snapshot" :: held 4.701s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" released by "_create_volume_from_snapshot" :: held 4.734s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.753s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.239s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1341102709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d50f4c-d036-47cf-822a-ef09cf269a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd309b60f1ae4a4d914b55892bdc5659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:12Z,use_quota=True,user_id='0177b48ecc1f4fc2be004e2de2974cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Creating volume 03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:17 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:17 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 1073741824 Apr 15 13:41:17 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e4d52a-057f-49b2-80ac-8f1f28697132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d', 'volume_size': 1, 'snapshot_id': '6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8547fdd3-d1bd-4b59-8a1d-b8e4a64c3b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:17 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Volume volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d (3f8e509c-c34a-4130-a4d8-fa77df70ff2d): created successfully Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8547fdd3-d1bd-4b59-8a1d-b8e4a64c3b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Flow 'volume_create_manager' (2756f2ae-e3ee-4cf8-895a-66f7e3fd819b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:17 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-de6a63f9-1cf0-41c4-9034-acbbb35a51e3 tempest-VolumeDependencyTests-551675859 None] Created volume successfully. Apr 15 13:41:17 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 1073741824" returned: 0 in 0.510s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:17 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 Apr 15 13:41:17 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Lock "cinder-6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-quobyte-97306009-7e64-46dc-b15f-a607ec3c8461" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-97306009-7e64-46dc-b15f-a607ec3c8461" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-quobyte-6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Deleting offline snapshot 6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d of volume 97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] snapshot_file for this snap is: volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a914b03c-be95-4ec5-a882-7026e95bfcbc]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:17 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:18 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d Apr 15 13:41:18 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:18 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32" returned: 0 in 0.492s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.575s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093144305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6119a0-9678-4a13-8114-792042622ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:14Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Creating volume 2f6119a0-9678-4a13-8114-792042622ebe {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:18 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8559ae34-e122-4f81-b6ef-df468c83cb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d50f4c-d036-47cf-822a-ef09cf269a32', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:18 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe 1073741824 Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf4f168-d27e-403a-acdb-18dbee9cb1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:18 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:18 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Volume volume-03d50f4c-d036-47cf-822a-ef09cf269a32 (03d50f4c-d036-47cf-822a-ef09cf269a32): created successfully Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf4f168-d27e-403a-acdb-18dbee9cb1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Flow 'volume_create_manager' (a0a7a746-1976-474b-9432-eb9c1b119445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:18 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-f825b5a7-0aac-422f-97b9-c131501cbc2d tempest-SnapshotDependencyTests-1833096270 None] Created volume successfully. Apr 15 13:41:18 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d" returned: 0 in 0.600s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97306009-7e64-46dc-b15f-a607ec3c8461(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e60e4f-ec9d-4ceb-bd14-e63aff65d5bb]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:18 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 Apr 15 13:41:18 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:18 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe 1073741824" returned: 0 in 0.559s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:18 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe Apr 15 13:41:18 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (74abb043-3472-408a-a110-554362bfcd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353c7655-4ffe-408a-a1c0-8ba7f5d67af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353c7655-4ffe-408a-a1c0-8ba7f5d67af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-234834680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279929e8-799a-413d-9375-3f56fcc40e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:19Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1e4c16-faf7-4ce8-8713-48da814ee128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1e4c16-faf7-4ce8-8713-48da814ee128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1821e09-306b-41a8-aeb4-8495370d21d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1821e09-306b-41a8-aeb4-8495370d21d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279929e8-799a-413d-9375-3f56fcc40e5f', 'volume_name': 'volume-279929e8-799a-413d-9375-3f56fcc40e5f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0147d2a9-31a2-4e9f-a6df-db195161c8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0147d2a9-31a2-4e9f-a6df-db195161c8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5c76b8-88f8-460d-83a3-7c71ba75c5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:18 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume 279929e8-799a-413d-9375-3f56fcc40e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279929e8-799a-413d-9375-3f56fcc40e5f', 'volume_size': 1} Apr 15 13:41:18 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:19 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461" returned: 0 in 0.534s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:19 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d Apr 15 13:41:19 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:19 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe" returned: 0 in 0.452s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.423s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1424801517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958137d1-24a6-42e6-a694-2484d502ad4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:14Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Creating volume 958137d1-24a6-42e6-a694-2484d502ad4f {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:19 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11642712-02bd-4f02-a589-9a9da4d127af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6119a0-9678-4a13-8114-792042622ebe', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff514ef-91bb-4458-85a1-fceb90128c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:19 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f 1073741824 Apr 15 13:41:19 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:19 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume volume-2f6119a0-9678-4a13-8114-792042622ebe (2f6119a0-9678-4a13-8114-792042622ebe): created successfully Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff514ef-91bb-4458-85a1-fceb90128c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (3c1523eb-11fd-445c-9acc-b5b6e842957d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:19 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2b58336d-e995-425f-aec9-a2f2ea08d6e4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created volume successfully. Apr 15 13:41:19 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d" returned: 0 in 0.462s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:19 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d Apr 15 13:41:19 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:19 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f 1073741824" returned: 0 in 0.508s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:19 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:19 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f Apr 15 13:41:19 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:20 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461.6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d" returned: 0 in 0.463s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d" released by "_delete_snapshot" :: held 2.120s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-97306009-7e64-46dc-b15f-a607ec3c8461" released by "delete_snapshot" :: held 2.134s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Created reservations ['1bbd4772-6319-44a8-aa48-dc7e7f631f4f', '83c45572-1136-47d5-8b89-dc8ec0e79977', 'bb857a3d-1532-4077-8ca6-83a34dd05a05', '13608a6b-5959-42a4-bf06-30ce3e6bbdd4'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:20 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Delete snapshot completed successfully. Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-23fc5996-0ce8-4635-9db4-74b3e727fbfd tempest-VolumeDependencyTests-551675859 None] Lock "cinder-6ac6fe61-7bd1-40db-bbe8-6a0b75eed36d-delete_snapshot" released by "delete_snapshot" :: held 2.213s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:20 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f" returned: 0 in 0.478s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.306s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1875556203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de65f30-3ad4-494b-9719-b80756516345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:14Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Creating volume 3de65f30-3ad4-494b-9719-b80756516345 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:20 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff27bd7-ec8e-4320-bf64-c3b01d9f4432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958137d1-24a6-42e6-a694-2484d502ad4f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8af9e30-0f37-49b1-a311-e545b935de5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:20 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345 1073741824 Apr 15 13:41:20 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:20 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume volume-958137d1-24a6-42e6-a694-2484d502ad4f (958137d1-24a6-42e6-a694-2484d502ad4f): created successfully Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8af9e30-0f37-49b1-a311-e545b935de5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (9e6a5f42-a029-46e3-98ed-dc6ef6efdb82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:20 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-78c42499-e699-4467-aa61-5d45e32c62fe tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created volume successfully. Apr 15 13:41:20 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345 1073741824" returned: 0 in 0.490s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:20 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:20 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345 Apr 15 13:41:20 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-97306009-7e64-46dc-b15f-a607ec3c8461-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Lock "cinder-97306009-7e64-46dc-b15f-a607ec3c8461-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-quobyte-97306009-7e64-46dc-b15f-a607ec3c8461" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-97306009-7e64-46dc-b15f-a607ec3c8461" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[386dcb4f-eb6e-4e28-ae4b-478b444a358e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:21 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 Apr 15 13:41:21 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:21 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345" returned: 0 in 0.437s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.784s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-818027526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84c1aca-a6df-4c20-8fd3-3473704d745b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:14Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Creating volume c84c1aca-a6df-4c20-8fd3-3473704d745b {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:21 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ee892d-4cd5-41a5-a4d2-55eafd117d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de65f30-3ad4-494b-9719-b80756516345', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:21 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b 1073741824 Apr 15 13:41:21 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5a326d-5d67-4fe1-ac13-690de615bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:21 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume volume-3de65f30-3ad4-494b-9719-b80756516345 (3de65f30-3ad4-494b-9719-b80756516345): created successfully Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5a326d-5d67-4fe1-ac13-690de615bf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (f1a47daf-1467-4bf9-a6e2-cd696e2ba166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:21 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-fb165870-74da-4eca-bf4b-b11ec5ad7ec4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created volume successfully. Apr 15 13:41:21 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461" returned: 0 in 0.475s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:21 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461 Apr 15 13:41:21 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:21 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b 1073741824" returned: 0 in 0.497s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:21 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:21 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b Apr 15 13:41:21 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:22 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-97306009-7e64-46dc-b15f-a607ec3c8461" returned: 0 in 0.467s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-97306009-7e64-46dc-b15f-a607ec3c8461" released by "delete_volume" :: held 0.980s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Created reservations ['0ebfee18-ade5-4673-bdcf-c5095ab49c4f', '1d9f988e-abef-48fb-94f9-5f5ec6b0bc28', 'c541da85-4546-4814-ae0f-0affbd4e64c4', 'deb60a3b-4bc5-4c0a-b146-de21bcc7ec47'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:22 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:22 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:22 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b" returned: 0 in 0.458s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.801s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406708984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d9f61c-42f5-4fa3-b425-fc9448b0702b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87466913e1c468a99a7aad0365dfb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:15Z,use_quota=True,user_id='69454a8ed0c04b02abcafa9b1ea40834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Creating volume 91d9f61c-42f5-4fa3-b425-fc9448b0702b {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:22 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a18bd4e-7d67-40f0-8f04-3c8297db68e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c84c1aca-a6df-4c20-8fd3-3473704d745b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c134217-ef61-4d63-8467-a6da15ad4819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:22 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b 1073741824 Apr 15 13:41:22 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume volume-c84c1aca-a6df-4c20-8fd3-3473704d745b (c84c1aca-a6df-4c20-8fd3-3473704d745b): created successfully Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c134217-ef61-4d63-8467-a6da15ad4819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (927204f6-8c0e-4c4a-92d7-60b5afe966ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:22 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-445221ed-f763-4bd9-9797-37bebe69f805 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created volume successfully. Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Flow 'volume_create_manager' (41e435ea-c83c-43ab-93bc-177346d1622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0385b8-d3b4-4459-9cc0-57c7e3e763be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0385b8-d3b4-4459-9cc0-57c7e3e763be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-46653948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20315cdc-ad9d-4083-b5d8-3c3372fc9f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5884acb768414047b4d46fd321a2fe76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:22Z,use_quota=True,user_id='ea63608f2026468fb0a97d3521650e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e783856f-25c6-4864-9369-e5312e7d96be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e783856f-25c6-4864-9369-e5312e7d96be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a4a7a1-f5d6-4672-b5e2-4bf114cf3d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a4a7a1-f5d6-4672-b5e2-4bf114cf3d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20315cdc-ad9d-4083-b5d8-3c3372fc9f3a', 'volume_name': 'volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dabff263-dc4e-4645-9416-d8d4a1e6b923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dabff263-dc4e-4645-9416-d8d4a1e6b923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b9a574-fbff-420f-83ab-d0cdc09634c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:22 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Volume 20315cdc-ad9d-4083-b5d8-3c3372fc9f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a', 'volume_size': 1} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:22 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.485s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:22 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Deleted volume successfully. Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c5c1eeb1-d98b-4062-b551-4707c4abb7fe tempest-VolumeDependencyTests-551675859 None] Lock "cinder-97306009-7e64-46dc-b15f-a607ec3c8461-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:22 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b 1073741824" returned: 0 in 0.567s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:22 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:22 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b Apr 15 13:41:22 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:23 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b" returned: 0 in 0.423s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.606s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0f8631-eeff-490b-9be2-f4790d59a807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f10d2b3-5a07-4824-afb1-521bd684e0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Creating offline snapshot 15471450-ccd0-46df-ad6f-4d2fa7471ab5 of volume 03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:41:23 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Volume volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b (91d9f61c-42f5-4fa3-b425-fc9448b0702b): created successfully Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f10d2b3-5a07-4824-afb1-521bd684e0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Flow 'volume_create_manager' (754890c3-58c9-4bc3-bbb6-134bcab4b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7a8a0d-20ab-448e-af46-d4665e687f50]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:23 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-f706ef9c-e86c-470e-b478-75ef41ff08c4 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created volume successfully. Apr 15 13:41:23 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 Apr 15 13:41:23 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-91d9f61c-42f5-4fa3-b425-fc9448b0702b-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-91d9f61c-42f5-4fa3-b425-fc9448b0702b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-quobyte-91d9f61c-42f5-4fa3-b425-fc9448b0702b" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-91d9f61c-42f5-4fa3-b425-fc9448b0702b" acquired by "delete_volume" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[44637430-90b8-429e-82cc-5166d78c02f2]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:23 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b Apr 15 13:41:23 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:23 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32" returned: 0 in 0.523s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:23 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:23 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 1G Apr 15 13:41:23 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:24 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:24 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b Apr 15 13:41:24 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:24 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 1G" returned: 0 in 0.494s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d50f4c-d036-47cf-822a-ef09cf269a32 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:24 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d50f4c-d036-47cf-822a-ef09cf269a32 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 Apr 15 13:41:24 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:24 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-91d9f61c-42f5-4fa3-b425-fc9448b0702b" returned: 0 in 0.441s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-91d9f61c-42f5-4fa3-b425-fc9448b0702b" released by "delete_volume" :: held 0.954s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created reservations ['74cd4abd-02bb-4dea-b501-3db14b28dda1', '7bb7d382-f73e-4298-9d61-7c0b8a5709f1', '91e7df32-c04a-45fd-9790-d1df6a21dac4', 'bac8eec9-2f89-4815-81f5-71f649a38c00'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-c84c1aca-a6df-4c20-8fd3-3473704d745b-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:24 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:24 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-c84c1aca-a6df-4c20-8fd3-3473704d745b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-quobyte-c84c1aca-a6df-4c20-8fd3-3473704d745b" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-c84c1aca-a6df-4c20-8fd3-3473704d745b" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:24 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d50f4c-d036-47cf-822a-ef09cf269a32 -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5" returned: 0 in 0.483s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:24 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 is being set with open permissions: ugo+rw Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5cf1be-b634-4b31-9f9d-39414545696d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:24 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:24 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 Apr 15 13:41:24 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:24 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b Apr 15 13:41:24 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:25 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.442s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:25 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Deleted volume successfully. Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-37b9add7-cb72-4053-8bda-d9849a2b12bb tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-91d9f61c-42f5-4fa3-b425-fc9448b0702b-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:25 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5" returned: 0 in 0.427s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:25 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.info Apr 15 13:41:25 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:25 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b" returned: 0 in 0.506s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:25 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b Apr 15 13:41:25 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:25 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.info" returned: 0 in 0.440s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:25 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.info is being set with open permissions: ugo+rw Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:25 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.info Apr 15 13:41:25 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:25 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-c84c1aca-a6df-4c20-8fd3-3473704d745b" returned: 0 in 0.430s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-c84c1aca-a6df-4c20-8fd3-3473704d745b" released by "delete_volume" :: held 0.972s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created reservations ['e9ebbc2e-c10a-4780-b1cc-5d5fd26c3c4e', '75ce9974-d81d-4124-aaad-51f12ae99393', 'e6b0215a-22c7-4ef9-898e-22d6789b9f1f', '999e6c5a-bc59-4431-bb84-b14c26ab50de'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:25 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:25 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-3de65f30-3ad4-494b-9719-b80756516345-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-3de65f30-3ad4-494b-9719-b80756516345-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-quobyte-3de65f30-3ad4-494b-9719-b80756516345" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-3de65f30-3ad4-494b-9719-b80756516345" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36cdd03-7734-4048-b345-a66c9b74a1a4]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:25 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:26 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345 Apr 15 13:41:26 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:26 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.info" returned: 0 in 0.451s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.897s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.184s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-234834680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279929e8-799a-413d-9375-3f56fcc40e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:19Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Creating volume 279929e8-799a-413d-9375-3f56fcc40e5f {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:26 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:26 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f 1073741824 Apr 15 13:41:26 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:26 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-55b41ee1-dbe0-41d0-aa69-89b699c91d5a tempest-SnapshotDependencyTests-1833096270 None] Create snapshot completed successfully Apr 15 13:41:26 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.472s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:26 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Deleted volume successfully. Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-262a3171-180b-4840-9ca0-985fe0daa827 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-c84c1aca-a6df-4c20-8fd3-3473704d745b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:26 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345" returned: 0 in 0.516s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:26 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345 Apr 15 13:41:26 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:26 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f 1073741824" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:26 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f Apr 15 13:41:26 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:26 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3de65f30-3ad4-494b-9719-b80756516345" returned: 0 in 0.465s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:26 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-3de65f30-3ad4-494b-9719-b80756516345" released by "delete_volume" :: held 1.012s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created reservations ['727c35b5-94c7-48ff-90d9-f4ab992c7700', 'e705f658-720c-4400-aad0-101dc8f481ff', 'cbfc0bca-f46c-4e8f-8836-ba0cb72762d3', '8eb95aee-1351-478e-84c6-e4c011ced79e'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:27 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:27 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:27 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f" returned: 0 in 0.441s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.611s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-46653948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20315cdc-ad9d-4083-b5d8-3c3372fc9f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5884acb768414047b4d46fd321a2fe76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:22Z,use_quota=True,user_id='ea63608f2026468fb0a97d3521650e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Creating volume 20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:27 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5c76b8-88f8-460d-83a3-7c71ba75c5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279929e8-799a-413d-9375-3f56fcc40e5f', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f53bd6-7540-48cb-9959-4f3da45682d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:27 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume volume-279929e8-799a-413d-9375-3f56fcc40e5f (279929e8-799a-413d-9375-3f56fcc40e5f): created successfully Apr 15 13:41:27 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a 1073741824 Apr 15 13:41:27 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f53bd6-7540-48cb-9959-4f3da45682d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (74abb043-3472-408a-a110-554362bfcd17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:27 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-f8b91aee-ca22-4429-840c-42d85ec76b17 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created volume successfully. Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Flow 'volume_create_manager' (aecc9591-bc0f-4922-893e-41246059f15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672f6ca2-c39f-4e53-9c07-1cd24d7f25cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672f6ca2-c39f-4e53-9c07-1cd24d7f25cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7607da9-7d07-4c2d-b1f2-3177ada2a1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd309b60f1ae4a4d914b55892bdc5659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=15471450-ccd0-46df-ad6f-4d2fa7471ab5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:27Z,use_quota=True,user_id='0177b48ecc1f4fc2be004e2de2974cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15006732-c0b8-42e9-9e42-0d8d549c66dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15006732-c0b8-42e9-9e42-0d8d549c66dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728032d3-c117-4b8a-a2af-cd35a7031dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728032d3-c117-4b8a-a2af-cd35a7031dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7607da9-7d07-4c2d-b1f2-3177ada2a1da', 'volume_name': 'volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da', 'volume_size': 1, 'snapshot_id': '15471450-ccd0-46df-ad6f-4d2fa7471ab5'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cf35e5-941e-43b4-ad3b-53025218016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cf35e5-941e-43b4-ad3b-53025218016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (085dcde3-11d5-40aa-94a7-d87f73a16434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:27 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Volume d7607da9-7d07-4c2d-b1f2-3177ada2a1da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da', 'volume_size': 1, 'snapshot_id': '15471450-ccd0-46df-ad6f-4d2fa7471ab5'} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:27 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.461s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:27 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Deleted volume successfully. Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b416a4c7-d2f8-4c59-9638-1b1d6fff1434 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-3de65f30-3ad4-494b-9719-b80756516345-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:27 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a 1073741824" returned: 0 in 0.559s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:27 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:27 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a Apr 15 13:41:27 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-958137d1-24a6-42e6-a694-2484d502ad4f-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-958137d1-24a6-42e6-a694-2484d502ad4f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-quobyte-958137d1-24a6-42e6-a694-2484d502ad4f" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-958137d1-24a6-42e6-a694-2484d502ad4f" acquired by "delete_volume" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:28 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a" returned: 0 in 0.442s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[93592bae-5488-40f0-ba42-3b3e6e1b4b20]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.812s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "cinder-quobyte-15471450-ccd0-46df-ad6f-4d2fa7471ab5-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" by "_create_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b9a574-fbff-420f-83ab-d0cdc09634c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd72f5ff-f0ca-45d4-9ce0-0db00a7fd1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-15471450-ccd0-46df-ad6f-4d2fa7471ab5-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Creating volume d7607da9-7d07-4c2d-b1f2-3177ada2a1da from snapshot 15471450-ccd0-46df-ad6f-4d2fa7471ab5 {{(pid=82595) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "cinder-quobyte-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:28 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Volume volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a (20315cdc-ad9d-4083-b5d8-3c3372fc9f3a): created successfully Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd72f5ff-f0ca-45d4-9ce0-0db00a7fd1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Flow 'volume_create_manager' (41e435ea-c83c-43ab-93bc-177346d1622d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] snapshot: 15471450-ccd0-46df-ad6f-4d2fa7471ab5, volume: d7607da9-7d07-4c2d-b1f2-3177ada2a1da, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:41:28 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-5e93cf9a-49c9-4a34-8850-3c3a802daebf tempest-VolumeDependencyTests-551675859 None] Created volume successfully. Apr 15 13:41:28 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f Apr 15 13:41:28 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6cfe3b-a74d-42ab-b3a3-970df206e886]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:28 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 Apr 15 13:41:28 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (abab279f-b8b9-4acb-9ea7-027ed1266b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1980a8a-7853-4546-8c54-51a884c9c304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1980a8a-7853-4546-8c54-51a884c9c304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-990408888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d71e201-fae4-4e54-b97b-2a94deb14382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef47731-9b83-4fa9-ba5e-de8816a0f6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef47731-9b83-4fa9-ba5e-de8816a0f6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2929be89-97bf-40a7-aa73-b0c18bc489c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2929be89-97bf-40a7-aa73-b0c18bc489c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d71e201-fae4-4e54-b97b-2a94deb14382', 'volume_name': 'volume-7d71e201-fae4-4e54-b97b-2a94deb14382', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b3d24f-75b9-4325-ab53-f338e106c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b3d24f-75b9-4325-ab53-f338e106c8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80880cfa-ae26-48a1-9589-2890bd3a6d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume 7d71e201-fae4-4e54-b97b-2a94deb14382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d71e201-fae4-4e54-b97b-2a94deb14382', 'volume_size': 1} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:28 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f" returned: 0 in 0.536s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:28 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f Apr 15 13:41:28 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (73d796fa-f861-451c-98dc-89e56a58053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d34a04-453e-409e-8d26-01e19329ff10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d34a04-453e-409e-8d26-01e19329ff10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1617816063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9125960b-b311-4df9-9da2-8bc7d7f90226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84ad49f-5853-4e03-9453-70c53df45590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84ad49f-5853-4e03-9453-70c53df45590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99dfc25-eb9d-4909-95d7-e1e61203005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99dfc25-eb9d-4909-95d7-e1e61203005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9125960b-b311-4df9-9da2-8bc7d7f90226', 'volume_name': 'volume-9125960b-b311-4df9-9da2-8bc7d7f90226', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4702417-04d4-41ed-b87d-4ef97ccbe55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4702417-04d4-41ed-b87d-4ef97ccbe55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7063b066-d1d2-4a31-9175-c4c95b9180a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:28 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume 9125960b-b311-4df9-9da2-8bc7d7f90226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9125960b-b311-4df9-9da2-8bc7d7f90226', 'volume_size': 1} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:28 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5" returned: 0 in 0.663s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d50f4c-d036-47cf-822a-ef09cf269a32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3551a5c-82d4-4c39-b94e-304c14de1884]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:28 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:29 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 Apr 15 13:41:29 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (abf29f7e-b93c-49d9-9972-73c8c91f67d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8d2d25-c8cc-4d4b-a969-150312a7db42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8d2d25-c8cc-4d4b-a969-150312a7db42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1279881014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea88bf29-aa89-4199-bb0b-49e6ac811b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb036086-0ca4-42f8-a9dc-7fc507ce8840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb036086-0ca4-42f8-a9dc-7fc507ce8840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0bcb52-bdea-43c9-9677-fce10e26e454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0bcb52-bdea-43c9-9677-fce10e26e454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea88bf29-aa89-4199-bb0b-49e6ac811b73', 'volume_name': 'volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02ee41b-e92c-4590-9753-69c467b0db2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02ee41b-e92c-4590-9753-69c467b0db2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72c8206-46ea-4dea-8a69-5235bf2525a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume ea88bf29-aa89-4199-bb0b-49e6ac811b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73', 'volume_size': 1} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (1bd2af56-07b9-4783-b8a1-763846d6ca1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a27c8b-0216-4d92-8d69-ea7b78eeeed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a27c8b-0216-4d92-8d69-ea7b78eeeed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1367428012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d64eb8-f07d-467b-9dcd-094f7818aee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d64eb8-f07d-467b-9dcd-094f7818aee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4f0203-2907-4531-aaca-224dad42d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4f0203-2907-4531-aaca-224dad42d352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2', 'volume_name': 'volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7a397e-ffc3-40d9-b598-4b073105d680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7a397e-ffc3-40d9-b598-4b073105d680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76203fb-610c-43ab-b840-1d25f2960a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume 92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2', 'volume_size': 1} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Flow 'volume_create_manager' (8acb38b2-8fc7-4168-98ea-5404f02906f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be25f99-31b7-4a93-949b-93111759cf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be25f99-31b7-4a93-949b-93111759cf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-398340206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64387e67-8575-4448-b62d-5a11cd93b311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5884acb768414047b4d46fd321a2fe76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=20315cdc-ad9d-4083-b5d8-3c3372fc9f3a,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='ea63608f2026468fb0a97d3521650e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e32a5e-a34b-4c54-b080-02db521f527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e32a5e-a34b-4c54-b080-02db521f527b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec449ed7-b8de-4529-93fb-44754bae5949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec449ed7-b8de-4529-93fb-44754bae5949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '64387e67-8575-4448-b62d-5a11cd93b311', 'volume_name': 'volume-64387e67-8575-4448-b62d-5a11cd93b311', 'volume_size': 1, 'source_volid': '20315cdc-ad9d-4083-b5d8-3c3372fc9f3a', 'source_volstatus': 'available'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e537221-f5f2-47c7-97bf-f104132cdc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e537221-f5f2-47c7-97bf-f104132cdc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad88efb-93d4-4560-a6f9-f57344581cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Volume 64387e67-8575-4448-b62d-5a11cd93b311: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-64387e67-8575-4448-b62d-5a11cd93b311', 'volume_size': 1, 'source_volid': '20315cdc-ad9d-4083-b5d8-3c3372fc9f3a', 'source_volstatus': 'available'} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (3631e2a8-97ea-49a6-91d6-644a766e1f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e4c928-c8e3-41fa-bd3a-54fd8559b2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e4c928-c8e3-41fa-bd3a-54fd8559b2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-100429005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363cdb85-c971-4717-8956-b6203d9c6fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11e6c40-6b34-4c3b-a289-6aff9eb4c323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11e6c40-6b34-4c3b-a289-6aff9eb4c323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247f12b2-7f90-4303-80a8-49f23c5aee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247f12b2-7f90-4303-80a8-49f23c5aee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '363cdb85-c971-4717-8956-b6203d9c6fe5', 'volume_name': 'volume-363cdb85-c971-4717-8956-b6203d9c6fe5', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eee1297-2272-44c5-9938-f613404f7167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eee1297-2272-44c5-9938-f613404f7167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed3a49e-57c3-43b2-8ed9-ee86b45dba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:29 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume 363cdb85-c971-4717-8956-b6203d9c6fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-363cdb85-c971-4717-8956-b6203d9c6fe5', 'volume_size': 1} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-958137d1-24a6-42e6-a694-2484d502ad4f" returned: 0 in 0.832s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-958137d1-24a6-42e6-a694-2484d502ad4f" released by "delete_volume" :: held 1.402s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created reservations ['fc29612f-c5fd-4301-8ba4-850d749ac670', 'f25f1f3c-3c40-40ad-8c1b-d5389f280f45', 'f6938c6b-8dc7-4bda-a7af-53f221016ddf', 'd983f810-4f78-4472-ba33-3efa62fc6142'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:29 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32" returned: 0 in 0.625s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:29 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da Apr 15 13:41:29 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:29 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:29 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:29 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:30 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.540s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:30 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:30 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Deleted volume successfully. Apr 15 13:41:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-44cbd261-a0c9-4a18-9855-b4a9edf27c9b tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-958137d1-24a6-42e6-a694-2484d502ad4f-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-2f6119a0-9678-4a13-8114-792042622ebe-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-2f6119a0-9678-4a13-8114-792042622ebe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-quobyte-2f6119a0-9678-4a13-8114-792042622ebe" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:30 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-2f6119a0-9678-4a13-8114-792042622ebe" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:30 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9aaf47-7ff0-4c18-850e-a37b89fc203e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:30 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:31 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe Apr 15 13:41:31 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:31 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" returned: 0 in 2.109s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:31 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aad71b4-ed24-4452-9363-a4ccde472a25]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:31 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 Apr 15 13:41:31 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:31 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe" returned: 0 in 1.223s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:31 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:31 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe Apr 15 13:41:31 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:32 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-2f6119a0-9678-4a13-8114-792042622ebe" returned: 0 in 0.416s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-2f6119a0-9678-4a13-8114-792042622ebe" released by "delete_volume" :: held 1.674s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created reservations ['16620f96-d9a3-4c10-996e-3706c5662dd6', 'b941ce38-c991-4315-82a0-17a05d964e9a', '5775f8ea-0198-4500-9e38-a6547934e841', '9d01a563-482c-475d-ad4c-7e54fe101bbe'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:32 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32" returned: 0 in 0.626s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:41:32 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Converted 1024.00 MB image at 485.02 MB/s Apr 15 13:41:32 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da is being set with open permissions: ugo+rw Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:32 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da Apr 15 13:41:32 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:32 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:32 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-04fed66f-2305-41e7-8b3f-cd75d9edb0af-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-04fed66f-2305-41e7-8b3f-cd75d9edb0af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-quobyte-31a925aa-9749-4f2b-bed5-e01dca794a12" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-31a925aa-9749-4f2b-bed5-e01dca794a12" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-quobyte-04fed66f-2305-41e7-8b3f-cd75d9edb0af" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-04fed66f-2305-41e7-8b3f-cd75d9edb0af" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Deleting offline snapshot 04fed66f-2305-41e7-8b3f-cd75d9edb0af of volume 31a925aa-9749-4f2b-bed5-e01dca794a12 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] snapshot_file for this snap is: volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e9809a-038b-4097-9386-aad566130c2a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:32 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" returned: 0 in 0.485s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" released by "_copy_volume_from_snapshot" :: held 4.599s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-15471450-ccd0-46df-ad6f-4d2fa7471ab5-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" released by "_create_volume_from_snapshot" :: held 4.623s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.661s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.216s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-990408888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d71e201-fae4-4e54-b97b-2a94deb14382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Creating volume 7d71e201-fae4-4e54-b97b-2a94deb14382 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:32 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:32 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.458s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:32 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af Apr 15 13:41:32 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:32 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382 1073741824 Apr 15 13:41:32 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:32 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Deleted volume successfully. Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (085dcde3-11d5-40aa-94a7-d87f73a16434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da', 'volume_size': 1, 'snapshot_id': '15471450-ccd0-46df-ad6f-4d2fa7471ab5'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52207bb9-c36c-4e87-9fae-3501675971c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-8a574bf5-5695-441f-9817-ecd30416cf0d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-2f6119a0-9678-4a13-8114-792042622ebe-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:32 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Volume volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da (d7607da9-7d07-4c2d-b1f2-3177ada2a1da): created successfully Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52207bb9-c36c-4e87-9fae-3501675971c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:32 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Flow 'volume_create_manager' (aecc9591-bc0f-4922-893e-41246059f15d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:32 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c17f8f13-1d7f-447c-8fcb-30886145e408 tempest-SnapshotDependencyTests-1833096270 None] Created volume successfully. Apr 15 13:41:33 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af" returned: 0 in 0.508s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31a925aa-9749-4f2b-bed5-e01dca794a12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81d893a-ae17-472e-bca1-2937c3e5e5cb]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:33 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382 1073741824" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:33 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382 Apr 15 13:41:33 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:33 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 Apr 15 13:41:33 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_service.periodic_task [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82595) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:33 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:33 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:33 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382" returned: 0 in 0.488s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.958s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1617816063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9125960b-b311-4df9-9da2-8bc7d7f90226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Creating volume 9125960b-b311-4df9-9da2-8bc7d7f90226 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:33 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:33 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80880cfa-ae26-48a1-9589-2890bd3a6d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d71e201-fae4-4e54-b97b-2a94deb14382', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:33 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226 1073741824 Apr 15 13:41:33 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d859a8-a556-4721-ad5c-e722f69fa9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "cinder-15471450-ccd0-46df-ad6f-4d2fa7471ab5-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=148,cinder:INSERT=47,cinder:UPDATE=192,cinder:DELETE=19 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:41:33 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume volume-7d71e201-fae4-4e54-b97b-2a94deb14382 (7d71e201-fae4-4e54-b97b-2a94deb14382): created successfully Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d859a8-a556-4721-ad5c-e722f69fa9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (abab279f-b8b9-4acb-9ea7-027ed1266b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12" returned: 0 in 0.604s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:33 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:33 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-4d49de33-f84b-446d-8518-c0311ee8b610 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created volume successfully. Apr 15 13:41:33 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af Apr 15 13:41:33 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-15471450-ccd0-46df-ad6f-4d2fa7471ab5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "cinder-quobyte-03d50f4c-d036-47cf-822a-ef09cf269a32" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.517s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-dc19f3b4-76d9-4d64-9a25-6721bd63f045 None None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-03d50f4c-d036-47cf-822a-ef09cf269a32" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "cinder-quobyte-15471450-ccd0-46df-ad6f-4d2fa7471ab5" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-15471450-ccd0-46df-ad6f-4d2fa7471ab5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Deleting offline snapshot 15471450-ccd0-46df-ad6f-4d2fa7471ab5 of volume 03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] snapshot_file for this snap is: volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff66d828-86f6-4892-8b38-88b969092928]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:33 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:34 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 Apr 15 13:41:34 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:34 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226 1073741824" returned: 0 in 0.506s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:34 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af" returned: 0 in 0.490s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:34 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226 Apr 15 13:41:34 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:34 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af Apr 15 13:41:34 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:34 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5" returned: 0 in 0.517s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d50f4c-d036-47cf-822a-ef09cf269a32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cccc184-505e-48e7-9ee1-b4f6f1ec2890]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:34 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 Apr 15 13:41:34 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:34 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226" returned: 0 in 0.480s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:34 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.634s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1279881014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea88bf29-aa89-4199-bb0b-49e6ac811b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Creating volume ea88bf29-aa89-4199-bb0b-49e6ac811b73 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:34 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12.04fed66f-2305-41e7-8b3f-cd75d9edb0af" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:34 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73 1073741824 Apr 15 13:41:34 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7063b066-d1d2-4a31-9175-c4c95b9180a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9125960b-b311-4df9-9da2-8bc7d7f90226', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379d8b41-3f6c-4cd2-986a-47be0f546374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:34 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume volume-9125960b-b311-4df9-9da2-8bc7d7f90226 (9125960b-b311-4df9-9da2-8bc7d7f90226): created successfully Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379d8b41-3f6c-4cd2-986a-47be0f546374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (73d796fa-f861-451c-98dc-89e56a58053f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-04fed66f-2305-41e7-8b3f-cd75d9edb0af" released by "_delete_snapshot" :: held 2.187s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:34 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-31a925aa-9749-4f2b-bed5-e01dca794a12" released by "delete_snapshot" :: held 2.198s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:34 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e4ede4d6-0913-49f4-b4ca-5122f7356981 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created volume successfully. Apr 15 13:41:35 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created reservations ['4078141b-a469-40df-bf55-d06a742a880d', 'da882d0d-aa0b-4d8e-97b6-b96b025d49e5', '438fa5cb-bafa-4326-9012-22d97eab68c1', '2e7e4c63-541a-4342-a271-33f283bc9b83'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32" returned: 0 in 0.498s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:35 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 Apr 15 13:41:35 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:35 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Delete snapshot completed successfully. Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-e0bfcba0-51c7-4f28-a07c-bf3ff2b43154 tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-04fed66f-2305-41e7-8b3f-cd75d9edb0af-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:35 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73 1073741824" returned: 0 in 0.504s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:35 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73 Apr 15 13:41:35 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:35 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5" returned: 0 in 0.476s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:35 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5 Apr 15 13:41:35 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:35 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73" returned: 0 in 0.420s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.481s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1367428012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Creating volume 92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:35 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72c8206-46ea-4dea-8a69-5235bf2525a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7f226d-2e92-43e8-af20-f69f2502c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:35 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 1073741824 Apr 15 13:41:35 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:35 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73 (ea88bf29-aa89-4199-bb0b-49e6ac811b73): created successfully Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7f226d-2e92-43e8-af20-f69f2502c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (abf29f7e-b93c-49d9-9972-73c8c91f67d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:35 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a8585553-866b-46aa-a9a5-b06f3a98714c tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created volume successfully. Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-31a925aa-9749-4f2b-bed5-e01dca794a12-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-31a925aa-9749-4f2b-bed5-e01dca794a12-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:35 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32.15471450-ccd0-46df-ad6f-4d2fa7471ab5" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:35 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "cinder-quobyte-31a925aa-9749-4f2b-bed5-e01dca794a12" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-15471450-ccd0-46df-ad6f-4d2fa7471ab5" released by "_delete_snapshot" :: held 2.056s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-31a925aa-9749-4f2b-bed5-e01dca794a12" acquired by "delete_volume" :: waited 0.044s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-03d50f4c-d036-47cf-822a-ef09cf269a32" released by "delete_snapshot" :: held 2.080s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[4414c0a2-f946-4025-a8ec-2302bda3e3ae]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Created reservations ['b680783d-1145-4def-8867-77c69e072f5f', 'c64840b0-e793-41c4-8231-f239416eac81', 'e3cc5e2e-07e6-4d09-9b81-16ccee490c0c', '3a6046af-98c4-487b-b434-fc45c6789f20'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:36 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 Apr 15 13:41:36 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:36 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Delete snapshot completed successfully. Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d870d1de-677c-46e6-8ddf-f6dfe011d026 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-15471450-ccd0-46df-ad6f-4d2fa7471ab5-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:36 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 1073741824" returned: 0 in 0.624s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:36 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 Apr 15 13:41:36 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:36 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12" returned: 0 in 0.514s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:36 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12 Apr 15 13:41:36 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:36 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2" returned: 0 in 0.412s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.436s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:36 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Cloning volume 20315cdc-ad9d-4083-b5d8-3c3372fc9f3a to volume 64387e67-8575-4448-b62d-5a11cd93b311 Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76203fb-610c-43ab-b840-1d25f2960a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62ecbb3-9a7f-480e-ad36-2f555cf0f330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:36 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 (92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2): created successfully Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62ecbb3-9a7f-480e-ad36-2f555cf0f330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (1bd2af56-07b9-4783-b8a1-763846d6ca1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:36 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-adf025c9-c19c-47f6-b15d-c46b3cc7da92 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created volume successfully. Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Creating offline snapshot 43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d of volume 20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb20d36-d997-4537-9222-095ac5cc5cd5]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:36 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:37 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-31a925aa-9749-4f2b-bed5-e01dca794a12" returned: 0 in 0.444s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-quobyte-31a925aa-9749-4f2b-bed5-e01dca794a12" released by "delete_volume" :: held 0.991s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "cinder-03d50f4c-d036-47cf-822a-ef09cf269a32-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-03d50f4c-d036-47cf-822a-ef09cf269a32-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:37 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a Apr 15 13:41:37 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "cinder-quobyte-03d50f4c-d036-47cf-822a-ef09cf269a32" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Created reservations ['ad6497e6-b300-4374-9770-ce91244c70cf', '3027aa97-83ee-4a0a-a6f8-e6c7421bfaff', '24e0b62c-fda3-4fc3-814c-63d7c32ef403', 'b14c8c97-2a97-47d9-b5af-a9291d0e1c58'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-03d50f4c-d036-47cf-822a-ef09cf269a32" acquired by "delete_volume" :: waited 0.024s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[27552081-50b8-4dba-90f2-8b31affdd3df]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:37 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:37 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:37 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 Apr 15 13:41:37 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:37 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a" returned: 0 in 0.515s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:37 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d 1G Apr 15 13:41:37 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:37 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.445s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:37 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Deleted volume successfully. Apr 15 13:41:37 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32" returned: 0 in 0.510s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:37 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c55553f3-a8e1-4e90-bcd2-30c42357f62d tempest-CreateVolumesFromSnapshotTest-1686790138 None] Lock "cinder-31a925aa-9749-4f2b-bed5-e01dca794a12-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:37 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32 Apr 15 13:41:37 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:38 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d 1G" returned: 0 in 0.524s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:38 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d Apr 15 13:41:38 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:38 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-03d50f4c-d036-47cf-822a-ef09cf269a32" returned: 0 in 0.469s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-03d50f4c-d036-47cf-822a-ef09cf269a32" released by "delete_volume" :: held 1.012s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:UPDATE=214,cinder:DELETE=22,cinder:SELECT=162,cinder:INSERT=46 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Created reservations ['adae5b49-2087-4a92-8f3c-cc17c0d0dd41', 'f3a98822-1bc8-456c-9de2-eff5efaeaca2', '3b84680c-d4e8-4198-94af-4a5a627c863b', '0c9d8b48-b4fc-4050-b8f1-e934f694afe6'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:38 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:38 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:38 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d" returned: 0 in 0.514s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:38 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d is being set with open permissions: ugo+rw Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:38 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d Apr 15 13:41:38 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:38 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:38 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Deleted volume successfully. Apr 15 13:41:38 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-b56c1df8-65e3-4ed7-a9a2-77b1e6484840 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-03d50f4c-d036-47cf-822a-ef09cf269a32-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:39 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d" returned: 0 in 0.469s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:39 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.info Apr 15 13:41:39 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "cinder-d7607da9-7d07-4c2d-b1f2-3177ada2a1da-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-d7607da9-7d07-4c2d-b1f2-3177ada2a1da-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "cinder-quobyte-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[356445e0-81b5-4b83-b4e6-2fd00eed5c7a]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:39 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da Apr 15 13:41:39 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:39 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.info" returned: 0 in 0.524s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:39 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.info is being set with open permissions: ugo+rw Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:39 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.info Apr 15 13:41:39 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Flow 'volume_create_manager' (84bae1ad-e6f8-4d83-a856-8f602d52220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08b83ef-ae13-4b2d-be1b-3f79dc69809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08b83ef-ae13-4b2d-be1b-3f79dc69809d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ba80b8-eeb2-4dfe-afb4-aee6344e4599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9803769caf76486b9953f2b32c86f6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:40Z,use_quota=True,user_id='19c27831dbf9478cb37a51939bb022fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774efae2-10df-4bbd-9d32-cf0aebced9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774efae2-10df-4bbd-9d32-cf0aebced9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657ec161-48be-4a25-98ec-723b8c0d1f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657ec161-48be-4a25-98ec-723b8c0d1f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ba80b8-eeb2-4dfe-afb4-aee6344e4599', 'volume_name': 'volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04abb9f6-194c-4de4-8c47-489182e7ae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04abb9f6-194c-4de4-8c47-489182e7ae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:39 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71ea427-9272-4b8f-9bc3-53db0a2724f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:39 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Volume 68ba80b8-eeb2-4dfe-afb4-aee6344e4599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599', 'volume_size': 1} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" returned: 0 in 0.602s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:39 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:39 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da Apr 15 13:41:39 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:40 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.info" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-quobyte-64387e67-8575-4448-b62d-5a11cd93b311" by "_copy_volume_from_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-64387e67-8575-4448-b62d-5a11cd93b311" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] snapshot: 43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d, volume: 64387e67-8575-4448-b62d-5a11cd93b311, {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40050e4-89ed-49ce-8b2e-4d617bf40ba3]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:40 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d Apr 15 13:41:40 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:40 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" returned: 0 in 0.439s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-quobyte-d7607da9-7d07-4c2d-b1f2-3177ada2a1da" released by "delete_volume" :: held 1.066s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Created reservations ['a6c80f4a-0edb-48dd-bc50-8359131985b7', '9319e2ef-5f3b-4f7a-adad-f76f3619b570', '5752914c-6f1e-4027-96f4-572138ff5e2c', '76c68821-2390-432a-b7b1-d5d2f2386ec6'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:40 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:40 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:40 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d" returned: 0 in 0.493s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] will copy from snapshot at /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Creating direct copy from snapshot {{(pid=82595) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[259e9d29-5252-43a1-a263-1118c9aaa02c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:40 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a Apr 15 13:41:40 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:40 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.448s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:40 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Deleted volume successfully. Apr 15 13:41:40 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-0ccc6dee-b638-4c44-a4ff-0fce3ac228a4 tempest-SnapshotDependencyTests-1833096270 None] Lock "cinder-d7607da9-7d07-4c2d-b1f2-3177ada2a1da-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:41 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a" returned: 0 in 0.477s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:41 devstack cinder-volume[82595]: DEBUG cinder.utils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Path /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 not found in is_blk_device check {{(pid=82595) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 13:41:41 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:41 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 Apr 15 13:41:41 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:43 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311" returned: 0 in 2.191s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:43 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec63718-6892-4d07-96f4-04a5713825bc]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:43 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a Apr 15 13:41:43 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:43 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a" returned: 0 in 0.641s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:43 devstack cinder-volume[82595]: DEBUG cinder.image.image_utils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Image conversion details: src /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 {{(pid=82595) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 13:41:43 devstack cinder-volume[82595]: INFO cinder.image.image_utils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Converted 1024.00 MB image at 467.15 MB/s Apr 15 13:41:43 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 is being set with open permissions: ugo+rw Apr 15 13:41:43 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:43 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 Apr 15 13:41:43 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:44 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311" returned: 0 in 0.539s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-64387e67-8575-4448-b62d-5a11cd93b311" released by "_copy_volume_from_snapshot" :: held 4.385s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-quobyte-43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:44 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Deleting offline snapshot 43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d of volume 20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:41:44 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] snapshot_file for this snap is: volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:41:44 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[30720160-bb1c-45ab-bf79-70c50c8eef63]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:44 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:44 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d Apr 15 13:41:44 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:45 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d" returned: 0 in 0.549s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:45 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:41:45 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40afb20-4f16-4068-a119-7358980dc151]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:45 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a Apr 15 13:41:45 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:45 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a" returned: 0 in 0.501s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:45 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:45 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d Apr 15 13:41:45 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:46 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d" returned: 0 in 0.480s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:46 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d Apr 15 13:41:46 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:46 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a.43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d" returned: 0 in 0.446s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-43fcf04a-c0b5-49eb-98e0-afc3f6d8eb1d" released by "_delete_snapshot" :: held 2.031s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.615s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.991s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-100429005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363cdb85-c971-4717-8956-b6203d9c6fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4cf59dfa0c4e49bcea253542863f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:29Z,use_quota=True,user_id='fd6a82263188404e9cf3caaee005bf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Creating volume 363cdb85-c971-4717-8956-b6203d9c6fe5 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:46 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad88efb-93d4-4560-a6f9-f57344581cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64387e67-8575-4448-b62d-5a11cd93b311', 'volume_size': 1, 'source_volid': '20315cdc-ad9d-4083-b5d8-3c3372fc9f3a', 'source_volstatus': 'available'}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:46 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5 1073741824 Apr 15 13:41:46 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2782e247-ffe2-48bf-8917-0a9292d98cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:46 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Volume volume-64387e67-8575-4448-b62d-5a11cd93b311 (64387e67-8575-4448-b62d-5a11cd93b311): created successfully Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2782e247-ffe2-48bf-8917-0a9292d98cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:46 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Flow 'volume_create_manager' (8acb38b2-8fc7-4168-98ea-5404f02906f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:46 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-1df8bdba-5c71-4234-8b48-286b1ccf2875 tempest-VolumeDependencyTests-551675859 None] Created volume successfully. Apr 15 13:41:47 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5 1073741824" returned: 0 in 0.549s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:47 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5 Apr 15 13:41:47 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-quobyte-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c47c62b-0469-4ca3-8c9b-bfa5d35633d9]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:47 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5" returned: 0 in 0.517s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:47 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a Apr 15 13:41:47 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.680s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ba80b8-eeb2-4dfe-afb4-aee6344e4599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9803769caf76486b9953f2b32c86f6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:40Z,use_quota=True,user_id='19c27831dbf9478cb37a51939bb022fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Creating volume 68ba80b8-eeb2-4dfe-afb4-aee6344e4599 {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:47 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed3a49e-57c3-43b2-8ed9-ee86b45dba50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-363cdb85-c971-4717-8956-b6203d9c6fe5', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62eeb5f1-47e9-4efe-99c5-affd5c7f438d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:47 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599 1073741824 Apr 15 13:41:47 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:47 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Volume volume-363cdb85-c971-4717-8956-b6203d9c6fe5 (363cdb85-c971-4717-8956-b6203d9c6fe5): created successfully Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62eeb5f1-47e9-4efe-99c5-affd5c7f438d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Flow 'volume_create_manager' (3631e2a8-97ea-49a6-91d6-644a766e1f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:47 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-0b1b6949-659b-4ef2-be29-455c6d1d5afd tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created volume successfully. Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-363cdb85-c971-4717-8956-b6203d9c6fe5-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-363cdb85-c971-4717-8956-b6203d9c6fe5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-quobyte-363cdb85-c971-4717-8956-b6203d9c6fe5" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-363cdb85-c971-4717-8956-b6203d9c6fe5" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[090d1b46-800a-4850-a8be-364d35ae2669]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:47 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:48 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5 Apr 15 13:41:48 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:48 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a" returned: 0 in 0.519s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:48 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a Apr 15 13:41:48 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:48 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599 1073741824" returned: 0 in 0.591s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:48 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599 Apr 15 13:41:48 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:48 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5" returned: 0 in 0.575s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:48 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5 Apr 15 13:41:48 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:48 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a" returned: 0 in 0.625s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a" released by "delete_volume" :: held 1.184s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Created reservations ['52035249-a1ea-4050-9df4-1399129b063b', '2e98bfae-ce30-4e6b-80cd-3ef2478bd6d2', 'fd9a3234-462a-4bff-906b-4e8321bf8569', '845fc16c-0106-46cc-b74a-b02e3543b2de'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:48 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599" returned: 0 in 0.503s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71ea427-9272-4b8f-9bc3-53db0a2724f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d04d8e-6784-4da5-9690-1bcc9ddc0825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:48 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Volume volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599 (68ba80b8-eeb2-4dfe-afb4-aee6344e4599): created successfully Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d04d8e-6784-4da5-9690-1bcc9ddc0825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Flow 'volume_create_manager' (84bae1ad-e6f8-4d83-a856-8f602d52220b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:48 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:48 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-5940af15-8f4c-4861-8e72-5c381ccef934 tempest-CinderUnicodeTest-1382407764 None] Created volume successfully. Apr 15 13:41:48 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:48 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:49 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-363cdb85-c971-4717-8956-b6203d9c6fe5" returned: 0 in 0.533s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-363cdb85-c971-4717-8956-b6203d9c6fe5" released by "delete_volume" :: held 1.138s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created reservations ['aaacaaf4-b4fb-4619-8f88-6a34cb8485a6', '6d06f46f-e332-4981-9568-2fee7ab4b649', '15dfbfc5-716f-4e0b-958b-7f5922818491', '66323c40-82ea-4c34-a143-53198249eb0b'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:49 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:49 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:49 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.447s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:49 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Deleted volume successfully. Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-54440cf4-f1f9-4d40-94e2-7d7353233c73 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-20315cdc-ad9d-4083-b5d8-3c3372fc9f3a-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:49 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.441s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:49 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Deleted volume successfully. Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-d57fa685-16f9-4197-ba89-f684ed85e7a0 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-363cdb85-c971-4717-8956-b6203d9c6fe5-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-64387e67-8575-4448-b62d-5a11cd93b311-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-64387e67-8575-4448-b62d-5a11cd93b311-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-quobyte-64387e67-8575-4448-b62d-5a11cd93b311" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-64387e67-8575-4448-b62d-5a11cd93b311" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb7a533-ea0a-4e3e-a964-cc2bef5c71dc]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82595) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Flow 'volume_create_manager' (4b89e2f6-2893-4499-b689-42a13d4d6704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4abb656-fd9f-404a-9708-143acc0aecdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4abb656-fd9f-404a-9708-143acc0aecdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1125538328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c20f74e-7d13-4d0c-a318-355c98bf37ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9803769caf76486b9953f2b32c86f6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:50Z,use_quota=True,user_id='19c27831dbf9478cb37a51939bb022fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:49 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 Apr 15 13:41:49 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4be2384-c01e-4a26-9c7f-a4489bec7798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4be2384-c01e-4a26-9c7f-a4489bec7798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e138a50c-4c54-442e-b4e7-9346bc851ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e138a50c-4c54-442e-b4e7-9346bc851ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c20f74e-7d13-4d0c-a318-355c98bf37ad', 'volume_name': 'volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4200c227-3b05-4445-a6e3-2682758aadd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4200c227-3b05-4445-a6e3-2682758aadd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7307e203-dcda-4012-b75d-f2405d291ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:49 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Volume 4c20f74e-7d13-4d0c-a318-355c98bf37ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad', 'volume_size': 1} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T11:41:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1125538328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c20f74e-7d13-4d0c-a318-355c98bf37ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9803769caf76486b9953f2b32c86f6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T11:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T11:41:50Z,use_quota=True,user_id='19c27831dbf9478cb37a51939bb022fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103b7da3-c731-4bdf-b1a0-8f6c8e0fa081),volume_type_id=103b7da3-c731-4bdf-b1a0-8f6c8e0fa081)}" {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Creating volume 4c20f74e-7d13-4d0c-a318-355c98bf37ad {{(pid=82595) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Selected osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e as target Quobyte volume. {{(pid=82595) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 13:41:49 devstack cinder-volume[82595]: INFO cinder.volume.drivers.remotefs [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] casted to osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e Apr 15 13:41:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad 1073741824 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:49 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad 1073741824 Apr 15 13:41:49 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-quobyte-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c407c-d988-4fbc-94c8-f9899b858d04]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:50 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 Apr 15 13:41:50 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:50 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311" returned: 0 in 0.518s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:50 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311 Apr 15 13:41:50 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:50 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad 1073741824" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:50 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad Apr 15 13:41:50 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:50 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2" returned: 0 in 0.494s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:50 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2 Apr 15 13:41:50 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:50 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-64387e67-8575-4448-b62d-5a11cd93b311" returned: 0 in 0.430s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-64387e67-8575-4448-b62d-5a11cd93b311" released by "delete_volume" :: held 0.982s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Created reservations ['35dcfa0c-fc6f-497b-9a39-6de47179047d', '6416f18d-4d76-4e58-8fd8-2d850b8d36c2', '9bf931f3-5a95-49b1-8ccf-8f8e92e987bd', 'e662695b-a3aa-45c3-ba38-5c61518ab793'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:50 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad" returned: 0 in 0.439s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'} {{(pid=82595) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:50 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:50 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7307e203-dcda-4012-b75d-f2405d291ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad', 'volume_size': 1}' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99233e1a-0399-47cb-a3ab-189599239bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 13:41:50 devstack cinder-volume[82595]: INFO cinder.volume.flows.manager.create_volume [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Volume volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad (4c20f74e-7d13-4d0c-a318-355c98bf37ad): created successfully Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99233e1a-0399-47cb-a3ab-189599239bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82595) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Flow 'volume_create_manager' (4b89e2f6-2893-4499-b689-42a13d4d6704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82595) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 13:41:50 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-1d41b6a0-0d90-468b-8061-0182917dee9b tempest-CinderUnicodeTest-1382407764 None] Created volume successfully. Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-3f8e509c-c34a-4130-a4d8-fa77df70ff2d-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-3f8e509c-c34a-4130-a4d8-fa77df70ff2d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "cinder-quobyte-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ebf00c-693f-47f5-b2e1-d50073c59c2f]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:50 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:51 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d Apr 15 13:41:51 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:51 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2" returned: 0 in 0.473s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2" released by "delete_volume" :: held 0.988s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created reservations ['a4d686e5-f87a-4510-848a-352c91e81cd3', 'c2d3a959-6a96-4900-98b6-88c3d0956bdf', '9e276748-958c-4a0a-a4d5-6c742bfabd8f', '1344bcf5-0eba-4ce9-876e-382edef39f93'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:51 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:51 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:51 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.467s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:51 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Deleted volume successfully. Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-48666c1a-350a-4b14-9059-e79f419dab36 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-64387e67-8575-4448-b62d-5a11cd93b311-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:51 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" returned: 0 in 0.506s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:51 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d Apr 15 13:41:51 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:51 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.433s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:51 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Deleted volume successfully. Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-81543f27-dbdc-498e-9705-4bf0ccba19de tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-92a9cdeb-fce5-4c0c-adfd-5f0b9ecb42d2-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:51 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" returned: 0 in 0.416s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-quobyte-3f8e509c-c34a-4130-a4d8-fa77df70ff2d" released by "delete_volume" :: held 0.954s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Created reservations ['4f3b17e0-c09b-4f4d-9530-db8d2546d76d', '6d8b344b-f055-4641-8bc6-a3e907193a40', '0a2ca719-b413-48ae-9edf-a95700a6b96e', 'e0280447-d492-4dbf-bdf7-d39a7b4edf5f'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:51 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:52 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:52 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Creating offline snapshot 020c7a99-f4ed-40ec-9caa-de6033235d8f of volume 4c20f74e-7d13-4d0c-a318-355c98bf37ad {{(pid=82595) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba79719b-f7fe-45fd-850b-2ae6f71cc781]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-ea88bf29-aa89-4199-bb0b-49e6ac811b73-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-ea88bf29-aa89-4199-bb0b-49e6ac811b73-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:52 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad Apr 15 13:41:52 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-quobyte-ea88bf29-aa89-4199-bb0b-49e6ac811b73" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-ea88bf29-aa89-4199-bb0b-49e6ac811b73" acquired by "delete_volume" :: waited 0.014s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe8abd7-7c77-4c63-b6b5-579e505f0956]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:52 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73 Apr 15 13:41:52 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:52 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.471s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:52 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Deleted volume successfully. Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-471371c2-3757-45db-bc60-4f2cd63e0301 tempest-VolumeDependencyTests-551675859 None] Lock "cinder-3f8e509c-c34a-4130-a4d8-fa77df70ff2d-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:52 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad" returned: 0 in 0.541s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f 1G {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:52 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f 1G Apr 15 13:41:52 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:52 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73" returned: 0 in 0.573s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:52 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:52 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73 Apr 15 13:41:52 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:53 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f 1G" returned: 0 in 0.584s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:53 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f Apr 15 13:41:53 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:53 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-ea88bf29-aa89-4199-bb0b-49e6ac811b73" returned: 0 in 0.500s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-ea88bf29-aa89-4199-bb0b-49e6ac811b73" released by "delete_volume" :: held 1.094s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created reservations ['ded9edc8-12f8-4690-b07f-4e4b5a3ed7c5', '6e9820a8-bc6e-4a09-afcb-88f0891275e0', '3467ca5e-f356-4ce9-b1d5-cc7f87d22606', 'cf9c2f89-aec9-4a4c-a924-c8f9dd693eb1'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:53 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:53 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:53 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad -F qcow2 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f" returned: 0 in 0.446s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:53 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f is being set with open permissions: ugo+rw Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:53 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f Apr 15 13:41:53 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:53 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.415s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:53 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Deleted volume successfully. Apr 15 13:41:53 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-a3184ea5-450c-44e9-b48c-7a11af937414 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-ea88bf29-aa89-4199-bb0b-49e6ac811b73-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:54 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f" returned: 0 in 0.419s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:54 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.info Apr 15 13:41:54 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-9125960b-b311-4df9-9da2-8bc7d7f90226-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-9125960b-b311-4df9-9da2-8bc7d7f90226-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-quobyte-9125960b-b311-4df9-9da2-8bc7d7f90226" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-9125960b-b311-4df9-9da2-8bc7d7f90226" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6cf20a-ded6-4343-bf1c-53f5fe335e81]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:54 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226 Apr 15 13:41:54 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:54 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.info" returned: 0 in 0.451s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:54 devstack cinder-volume[82595]: WARNING cinder.volume.drivers.remotefs [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.info is being set with open permissions: ugo+rw Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.info {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:54 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.info Apr 15 13:41:54 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:54 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:54 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:54 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226 Apr 15 13:41:54 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:55 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.info" returned: 0 in 0.434s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:55 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-59f1ab0f-b3dd-47e6-90ec-c0e9eb17a7c8 tempest-CinderUnicodeTest-1382407764 None] Create snapshot completed successfully Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "cinder-020c7a99-f4ed-40ec-9caa-de6033235d8f-delete_snapshot" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-020c7a99-f4ed-40ec-9caa-de6033235d8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "cinder-quobyte-4c20f74e-7d13-4d0c-a318-355c98bf37ad" by "delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-quobyte-4c20f74e-7d13-4d0c-a318-355c98bf37ad" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "cinder-quobyte-020c7a99-f4ed-40ec-9caa-de6033235d8f" by "_delete_snapshot" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-quobyte-020c7a99-f4ed-40ec-9caa-de6033235d8f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Deleting offline snapshot 020c7a99-f4ed-40ec-9caa-de6033235d8f of volume 4c20f74e-7d13-4d0c-a318-355c98bf37ad {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] snapshot_file for this snap is: volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f {{(pid=82595) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c092404-0183-4461-b19d-ca827a7c1e8e]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:55 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f Apr 15 13:41:55 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:55 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-9125960b-b311-4df9-9da2-8bc7d7f90226" returned: 0 in 0.469s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-9125960b-b311-4df9-9da2-8bc7d7f90226" released by "delete_volume" :: held 0.970s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created reservations ['bdcba481-2e3e-4796-ac23-a075f087de47', '93c08b37-3322-45aa-a82c-cd2104f696ff', '4a279af0-19e6-44f9-806b-c786f525540d', '799ec4ea-07b3-4924-ade9-451ca8551cd3'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:55 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:55 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-7d71e201-fae4-4e54-b97b-2a94deb14382-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-7d71e201-fae4-4e54-b97b-2a94deb14382-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-quobyte-7d71e201-fae4-4e54-b97b-2a94deb14382" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-7d71e201-fae4-4e54-b97b-2a94deb14382" acquired by "delete_volume" :: waited 0.006s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e9320b-7e96-46ba-9de9-250ed0c1c34c]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:55 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382 Apr 15 13:41:55 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:55 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f" returned: 0 in 0.486s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.remotefs [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82595) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[be29bd95-6047-4080-9fb8-0e218dbc15db]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:55 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad Apr 15 13:41:55 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:55 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.450s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:55 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Deleted volume successfully. Apr 15 13:41:55 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3f6c00f4-2ed4-4b67-bba8-10b51323e588 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-9125960b-b311-4df9-9da2-8bc7d7f90226-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:56 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382" returned: 0 in 0.491s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:56 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382 Apr 15 13:41:56 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:56 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad" returned: 0 in 0.519s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:56 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f Apr 15 13:41:56 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:56 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-7d71e201-fae4-4e54-b97b-2a94deb14382" returned: 0 in 0.434s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-7d71e201-fae4-4e54-b97b-2a94deb14382" released by "delete_volume" :: held 0.962s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created reservations ['341f88ff-9653-402d-a87f-d367286211a2', 'b720641c-91c5-4e3a-9208-979a83919bf8', 'a6c98b3d-9e35-4dbc-a67b-75ac39d3f53e', '0c113f19-c296-4a8f-80b2-d51afe929d6f'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:56 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:56 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-279929e8-799a-413d-9375-3f56fcc40e5f-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-279929e8-799a-413d-9375-3f56fcc40e5f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "cinder-quobyte-279929e8-799a-413d-9375-3f56fcc40e5f" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-279929e8-799a-413d-9375-3f56fcc40e5f" acquired by "delete_volume" :: waited 0.023s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[d701cdc6-54f2-4b6f-89f4-87f5faf8ee1d]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:56 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f Apr 15 13:41:56 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:56 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f" returned: 0 in 0.492s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:56 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:56 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f Apr 15 13:41:56 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:57 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.440s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:57 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Deleted volume successfully. Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-c9bec75c-0a36-494e-a0fe-945afc5b18f5 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-7d71e201-fae4-4e54-b97b-2a94deb14382-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:57 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f" returned: 0 in 0.502s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:57 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f Apr 15 13:41:57 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:57 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad.020c7a99-f4ed-40ec-9caa-de6033235d8f" returned: 0 in 0.420s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-quobyte-020c7a99-f4ed-40ec-9caa-de6033235d8f" released by "_delete_snapshot" :: held 1.974s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-quobyte-4c20f74e-7d13-4d0c-a318-355c98bf37ad" released by "delete_snapshot" :: held 1.990s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Created reservations ['32fee10d-d05a-4faf-a3f0-5712891f1f41', '5e905541-35e9-4d9f-96bf-c857db2362bb', '2b8ec289-3fdb-4228-b263-de006fa1c0c8', '85274034-7480-46e9-9813-4ebd1838fd60'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:57 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Delete snapshot completed successfully. Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-2f8cf7e4-86b9-4692-a194-645829bd69e9 tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-020c7a99-f4ed-40ec-9caa-de6033235d8f-delete_snapshot" released by "delete_snapshot" :: held 2.077s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "cinder-4c20f74e-7d13-4d0c-a318-355c98bf37ad-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-4c20f74e-7d13-4d0c-a318-355c98bf37ad-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "cinder-quobyte-4c20f74e-7d13-4d0c-a318-355c98bf37ad" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-quobyte-4c20f74e-7d13-4d0c-a318-355c98bf37ad" acquired by "delete_volume" :: waited 0.007s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecd3fa9-b479-465e-9389-a5b88c490947]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:57 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad Apr 15 13:41:57 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:57 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-279929e8-799a-413d-9375-3f56fcc40e5f" returned: 0 in 0.450s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-quobyte-279929e8-799a-413d-9375-3f56fcc40e5f" released by "delete_volume" :: held 0.973s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Created reservations ['3796c702-b16c-4687-a44e-9c823a6e96bd', '33b41041-751d-4eb8-8690-d4f28a04c3d9', '57cae056-a27c-441f-b616-f2e16bda6838', '2f93a5ed-b733-4bec-9aea-ab4e45d8dfc5'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:57 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:57 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:57 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad" returned: 0 in 0.504s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:57 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:58 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad Apr 15 13:41:58 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:58 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.434s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:58 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Deleted volume successfully. Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-eae9b91e-3de0-4bfe-9a60-593208bf6a41 tempest-CreateVolumesFromSourceVolumeTest-845825635 None] Lock "cinder-279929e8-799a-413d-9375-3f56fcc40e5f-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:58 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-4c20f74e-7d13-4d0c-a318-355c98bf37ad" returned: 0 in 0.428s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-quobyte-4c20f74e-7d13-4d0c-a318-355c98bf37ad" released by "delete_volume" :: held 0.970s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Created reservations ['4cbe6d99-654c-434d-8fd1-929b75cd5c25', '7ad2fdf5-66d0-4727-aba6-3b705663735e', 'b13c45bf-dcc4-4fd2-b83e-0c4472971d4d', '364800f3-5400-4c67-bc54-02633f93521a'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:58 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:58 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "cinder-68ba80b8-eeb2-4dfe-afb4-aee6344e4599-delete_volume" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-68ba80b8-eeb2-4dfe-afb4-aee6344e4599-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "cinder-quobyte-68ba80b8-eeb2-4dfe-afb4-aee6344e4599" by "delete_volume" {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-quobyte-68ba80b8-eeb2-4dfe-afb4-aee6344e4599" acquired by "delete_volume" :: waited 0.009s {{(pid=82595) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0cef34-5643-4432-bfea-16bf329c9890]: (4, 'qcow2') {{(pid=83744) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:58 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599 Apr 15 13:41:58 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:58 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.481s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:58 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:41:58 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Deleted volume successfully. Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-967fbfef-d74b-4cf5-956f-0bd5c676d57c tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-4c20f74e-7d13-4d0c-a318-355c98bf37ad-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:59 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599" returned: 0 in 0.501s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:59 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599 Apr 15 13:41:59 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:41:59 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874/volume-68ba80b8-eeb2-4dfe-afb4-aee6344e4599" returned: 0 in 0.487s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-quobyte-68ba80b8-eeb2-4dfe-afb4-aee6344e4599" released by "delete_volume" :: held 1.016s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG cinder.quota [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Created reservations ['84800a87-97c2-4cd1-8333-befb6c0251a8', 'd287b62e-b705-4faa-9424-1eb3ee0c827f', '6f7ffd74-e300-4ba1-86a3-27e1679e71e0', 'd4d22b2d-de92-42f9-b5d7-b35b82fa1100'] {{(pid=82595) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e': None} {{(pid=82595) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG cinder.volume.drivers.quobyte [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e8a12bb-4786-463c-a2d1-55ede8bb590e'] {{(pid=82595) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82595) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 13:41:59 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 13:41:59 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874 Apr 15 13:41:59 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 13:42:00 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 15 13:42:00 devstack cinder-volume[82595]: DEBUG oslo_concurrency.processutils [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/74845bb140b23e42175d71a7f7cf6874" returned: 0 in 0.405s {{(pid=82595) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 13:42:00 devstack cinder-volume[82595]: DEBUG cinder.manager [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Notifying Schedulers of capabilities ... {{(pid=82595) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 13:42:00 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Deleted volume successfully. Apr 15 13:42:00 devstack cinder-volume[82595]: DEBUG cinder.coordination [None req-3455430d-14dd-415c-8804-0b2f7afb78bb tempest-CinderUnicodeTest-1382407764 None] Lock "cinder-68ba80b8-eeb2-4dfe-afb4-aee6344e4599-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82595) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 13:42:09 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=88,cinder:INSERT=28,cinder:UPDATE=126,cinder:DELETE=8 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 13:42:10 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:UPDATE=150,cinder:SELECT=89,cinder:INSERT=43,cinder:DELETE=12 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}